Dask

Changes

- Revert "Improve normalize\_chunks calculation for "auto" setting" jrbourbeau (11385)
- Bump peter-evans/create-pull-request from 6 to 7 dependabot (11380)
- Add a Task class to replace tuples for task specification fjetter (11248)
- Reduce overhead in tokenize fjetter (11373)
- Improve normalize\_chunks calculation for "auto" setting phofl (11354)
- Bump ``bokeh`` minimum version to 3.1.0 jrbourbeau (11375)
- Move ``tokenize`` to dedicated submodule fjetter (11371)
- Ensure process\_runnables is not too eager in the presence of multiple splits fjetter (11367)
- Use ``np.min\_scalar\_type`` in shuffle jrbourbeau (11369)
- Write indexing arrays into dask graph to reduce size for multiple xarray variables phofl (11362)
- Cast indexer to minimal dtype in shuffle phofl (11364)
- Reduce memory usage of dask.order fjetter (11361)
- Bump JamesIves/github-pages-deploy-action from 4.6.3 to 4.6.4 dependabot (11366)
- precommit autoupdate fjetter (11360)

See the [Changelog](https://docs.dask.org/en/stable/changelog.html) for more information.

- Add changelor entries for shuffle, vindex and blockwise\_reshape phofl (11350)
- Ensure persisted collections are released without GC fjetter (11348)
- Update zoom link for dask meeting scharlottej13 (11357)
- Add more docstring examples for ``normalize\_chunks`` Illviljan (11271)
- Choose automatically between tasks-based and p2p rechunking hendrikmakait (11337)
- Implement blockwise reshape phofl (11328)
- Make rechunking in shuffle more intelligent to distribute unevenly if necessary phofl (11326)
- Increase visibility of GPU CI updates charlesbluca (11345)
- Update ``numpy`` and ``pyarrow`` versions in install docs jrbourbeau (11340)
- Fixup dask and distributed dependencies phofl (11338)
- Bump `numpy>=1.24` and `pyarrow>=14.0.1` minimum versions jrbourbeau (11331)
- Add ``crick`` back to Python 3.11+ CI builds jrbourbeau (11335)
- Preserve chunksizes in vindex phofl (11330)
- Fix `dask.array.fft` mismatch with Numpy's interface (add support for `norm` argument) joanrue (10665)
- Pass additional parameters to `rechunk_p2p` hendrikmakait (11319)
- Fix docstring formatting for map\_overlap Tao-VanJS (11332)
- Fix NumPy overflowing for prod on 2.0 phofl (11327)
- tensordot: ensure `axes` are positive / add tests for negative axes joanrue (10812)
- Fix map\_overlap with new\_axis dstansby (11128)

See the [Changelog](https://docs.dask.org/en/stable/changelog.html) for more information.

Changes

- Ensure pickle does not change tokens fjetter (11320)
- Add changelog entry for reshape and ordering improvements phofl (11324)
- Rename chunksize-tolerance option phofl (11317)
- Upgrade gpuCI and fix Dask Array failures with "cupy" backend rjzamora (11309)
- Implement automatic rechunking for shuffle phofl (11311)
- Ensure we test against numpy 2 in CI jrbourbeau (11182)
- Revert "Test ordering on distributed scheduler (11310)" fjetter (11321)
- Test ordering on distributed scheduler fjetter (11310)
- Add tests to cover more cases of new reshape implementation phofl (11313)
- order: Choose better target for branches with multiple leaf nodes phofl (11303)
- order: ensure runnable tasks are certainly runnable fjetter (11305)
- Fix upstream numpy build phofl (11304)
- Make shuffle a no-op if possible phofl (11291)
- Keep chunksize consistent in reshape phofl (11273)
- Enable slicing with only one unknonw chunk phofl (11301)
- Link to dask vs spark benchmarks on dask docs scharlottej13 (11289)
- Fix slicing for masked arrays phofl (11300)
- array: fix `asarray` for array input with `dtype` lucascolley (11288)
- array: add constants lucascolley (11287)
- Ignore typing of return value phofl (11286)
- Remove automatic resizing in reshape phofl (11269)
- API: expose `np` dtypes in `dask.array` namespace lucascolley (11178)
- Drop support for Python 3.9 phofl (11245)

See the [Changelog](https://docs.dask.org/en/stable/changelog.html) for more information.

Changes

- Add changelog for dask order patch phofl (11278)
- order: add regression test for xarray map reduce fjetter (11277)
- Add changelog entry for take phofl (11274)
- Revert "order: remove data task graph normalization" phofl (11276)
- Use the shuffle algorithm for take phofl (11267)
- Implement task-based array shuffle phofl (11262)
- order: remove data task graph normalization fjetter (11263)
- Update zoom link for monthly meeting scharlottej13 (11265)
- Update data loading section of best practices phofl (11247)
- Match default chunksize in docstring to actual default set in code SwamyDev (11254)
- Fixup casting error in pandas 3 phofl (11250)
- Skip new warning from pandas phofl (11249)
- Fix pandas nightly bugs phofl (11244)

See the [Changelog](https://docs.dask.org/en/stable/changelog.html) for more information.

Changes

- Remove and warn of persist usage phofl (11237)
- Preserve timestamp unit during meta creation phofl (11233)
- Ensure that dask expr DataFrames are optimized when put into delayed phofl (11231)
- Fixes for ``d`` freq deprecation in ``pandas=3`` jrbourbeau (11228)
- bump approx threshold for test\_quantile fjetter (10720)
- Bump xarray-contrib/issue-from-pytest-log from 1.2.8 to 1.3.0 dependabot (11221)
- Bump JamesIves/github-pages-deploy-action from 4.6.1 to 4.6.3 dependabot (11222)

See the [Changelog](https://docs.dask.org/en/stable/changelog.html) for more information.

Changes

- Only count data that is in memory for xarray sizeof fjetter (11206)
- Fix botocore re-raising error phofl (11209)
- Update Coiled links in documentation scharlottej13 (11211)
- Add some array-expr methods phofl (11210)
- Fix quantile for arrow dtypes phofl (11202)
- Add utility to verify optional dependencies phofl (11205)
- Implement array expression switch phofl (11203)
- Drop support for pandas\<2 phofl (11199)
- Remove no longer supported ipython reference phofl (11196)
- Remove from\_delayed references phofl (11195)
- Add other IO connectors to docs phofl (11189)

See the [Changelog](https://docs.dask.org/en/stable/changelog.html) for more information.