Cubed

What's Changed
* Icechunk store by tomwhite in https://github.com/cubed-dev/cubed/pull/633
* Move retry logic to lithops by tomwhite in https://github.com/cubed-dev/cubed/pull/673
* Coverage improvements by tomwhite in https://github.com/cubed-dev/cubed/pull/674
* Add scalar support to `where` by tomwhite in https://github.com/cubed-dev/cubed/pull/679
* Add PendingDeprecationWarning for `map_direct` by tomwhite in https://github.com/cubed-dev/cubed/pull/682
* Add a rechunking example by tomwhite in https://github.com/cubed-dev/cubed/pull/681
* Remove Lithops retries tests since this is now tested upstream by tomwhite in https://github.com/cubed-dev/cubed/pull/683
* Using `default_dtypes` instead of hard-coding dtypes by alxmrs in https://github.com/cubed-dev/cubed/pull/666
* Array API status update for draft 2024 spec by tomwhite in https://github.com/cubed-dev/cubed/pull/684
* Refactor asyncio executors to share common code by tomwhite in https://github.com/cubed-dev/cubed/pull/685
* Add scalar support to binary element-wise ops by tomwhite in https://github.com/cubed-dev/cubed/pull/686
* Fix icechunk tests to opt-in to pickling of Session by tomwhite in https://github.com/cubed-dev/cubed/pull/688
* Move non-standardized functions to separate package by tomwhite in https://github.com/cubed-dev/cubed/pull/690
* Add Ray executor by tomwhite in https://github.com/cubed-dev/cubed/pull/687
* Allow nan functions to work with xarray by tomwhite in https://github.com/cubed-dev/cubed/pull/670
* Make callbacks context managers by tomwhite in https://github.com/cubed-dev/cubed/pull/691
* Adding pre-commit (for linting) to test dependencies by alxmrs in https://github.com/cubed-dev/cubed/pull/671
* Support float32 in random number generation by tomwhite in https://github.com/cubed-dev/cubed/pull/693
* Fix for Zarr 3.0.3 change to OrthogonalIndexer internals from Zarr 2784 by tomwhite in https://github.com/cubed-dev/cubed/pull/696
* Modal 1.0 changes by tomwhite in https://github.com/cubed-dev/cubed/pull/695
* Show nchunks on visualization by tomwhite in https://github.com/cubed-dev/cubed/pull/698
* Always set region for Modal executor by tomwhite in https://github.com/cubed-dev/cubed/pull/699
* Improve memory model by explicitly modelling buffer copies by tomwhite in https://github.com/cubed-dev/cubed/pull/701
* Multistage rechunking by tomwhite in https://github.com/cubed-dev/cubed/pull/700
* Remove duplicate code from new rechunk implementation by tomwhite in https://github.com/cubed-dev/cubed/pull/702
* Use extra buffer copies for cloud stores like S3 by tomwhite in https://github.com/cubed-dev/cubed/pull/703


**Full Changelog**: https://github.com/cubed-dev/cubed/compare/0.20.0...0.21.0

What's Changed
* Include task result in callbacks by tomwhite in https://github.com/cubed-dev/cubed/pull/632
* Pin dask and distributed to < 2024.12.0 by tomwhite in https://github.com/cubed-dev/cubed/pull/639
* Fix Modal deprecation (show progress) and pip package by tomwhite in https://github.com/cubed-dev/cubed/pull/634
* Remove test 'extras' and run lithops tests separately by tomwhite in https://github.com/cubed-dev/cubed/pull/640
* Array API tests fixes by tomwhite in https://github.com/cubed-dev/cubed/pull/636
* New tagline by tomwhite in https://github.com/cubed-dev/cubed/pull/641
* Add `tile` by tomwhite in https://github.com/cubed-dev/cubed/pull/644
* Add `searchsorted` by tomwhite in https://github.com/cubed-dev/cubed/pull/647
* Declare Array API 2023.12 support by tomwhite in https://github.com/cubed-dev/cubed/pull/651
* Change `chunk_shape` back to `chunks` for Zarr v3 by tomwhite in https://github.com/cubed-dev/cubed/pull/656
* Document use of `cubed.config` by tomwhite in https://github.com/cubed-dev/cubed/pull/654
* Make async executors work in Jupyter notebooks by tomwhite in https://github.com/cubed-dev/cubed/pull/661
* Add Zarr and Xarray examples to docs by tomwhite in https://github.com/cubed-dev/cubed/pull/655
* Fix tooltips for SVGs generated by `visualize()` in Jupyter notebooks by tomwhite in https://github.com/cubed-dev/cubed/pull/663
* Add note to contributing guide for developers to have `graphviz` installed by alxmrs in https://github.com/cubed-dev/cubed/pull/665
* Incorrect dtypes in `map_selection` by tomwhite in https://github.com/cubed-dev/cubed/pull/669

**Full Changelog**: https://github.com/cubed-dev/cubed/compare/0.19.0...0.20.0

What's Changed
* Support `block_id` for `general_blockwise` functions by tomwhite in https://github.com/cubed-dev/cubed/pull/593
* Run tests on Python 3.13 by tomwhite in https://github.com/cubed-dev/cubed/pull/503
* Fix dtypes for QR by tomwhite in https://github.com/cubed-dev/cubed/pull/594
* Change usages of `map_direct` in QR to `general_blockwise` by tomwhite in https://github.com/cubed-dev/cubed/pull/597
* Implement `var` and `std` using a numerically stable parallel algorithm by tomwhite in https://github.com/cubed-dev/cubed/pull/596
* Add `map_selection` primitive to replace `map_direct` by tomwhite in https://github.com/cubed-dev/cubed/pull/595
* Use `unstack` from array-api-compat by tomwhite in https://github.com/cubed-dev/cubed/pull/602
* Increase `allowed_mem` default to 2GB by tomwhite in https://github.com/cubed-dev/cubed/pull/599
* Implement structured arrays as Zarr group of arrays by tomwhite in https://github.com/cubed-dev/cubed/pull/603
* Implement int array indexing using map_selection by tomwhite in https://github.com/cubed-dev/cubed/pull/604
* Implement merge_chunks using map_selection by tomwhite in https://github.com/cubed-dev/cubed/pull/605
* Free memory earlier by changing function scope by tomwhite in https://github.com/cubed-dev/cubed/pull/606
* Fix groupby tests running on tensorstore by tomwhite in https://github.com/cubed-dev/cubed/pull/608
* Implement concat using general_blockwise by tomwhite in https://github.com/cubed-dev/cubed/pull/607
* Speed up test collection by tomwhite in https://github.com/cubed-dev/cubed/pull/609
* Update GH actions to macos-13 test runner and upload-artifactv4 by tomwhite in https://github.com/cubed-dev/cubed/pull/611
* Implement `repeat` by tomwhite in https://github.com/cubed-dev/cubed/pull/610
* Map nested improvements by tomwhite in https://github.com/cubed-dev/cubed/pull/613
* SVD by tomwhite in https://github.com/cubed-dev/cubed/pull/598
* Unify chunks for `concat`, and check preconditions by tomwhite in https://github.com/cubed-dev/cubed/pull/616
* Defer to merge_chunks in special cases of rechunk by tomwhite in https://github.com/cubed-dev/cubed/pull/612
* Document `map_selection` core operation by tomwhite in https://github.com/cubed-dev/cubed/pull/617
* Change default `max_total_num_input_blocks` to 10 by tomwhite in https://github.com/cubed-dev/cubed/pull/615
* Update slides - November 2024 by tomwhite in https://github.com/cubed-dev/cubed/pull/620
* Change `use_backups` default to True only on cloud stores by tomwhite in https://github.com/cubed-dev/cubed/pull/619
* Various minor doc improvements by tomwhite in https://github.com/cubed-dev/cubed/pull/625
* Make `threads` the default executor by tomwhite in https://github.com/cubed-dev/cubed/pull/621
* Rewrite Cubed intro docs by tomwhite in https://github.com/cubed-dev/cubed/pull/622
* More doc improvements: simplify getting started page by tomwhite in https://github.com/cubed-dev/cubed/pull/629
* Add examples to docs by tomwhite in https://github.com/cubed-dev/cubed/pull/630


**Full Changelog**: https://github.com/cubed-dev/cubed/compare/0.18.0...0.19.0

What's Changed
* Multiple outputs by tomwhite in https://github.com/cubed-dev/cubed/pull/419
* Support use of multiprocessing start methods other than "spawn" (e.g. "dragon") by applio in https://github.com/cubed-dev/cubed/pull/554
* Tensorstore compression fix by tomwhite in https://github.com/cubed-dev/cubed/pull/574
* Implement `unstack` using multiple outputs by tomwhite in https://github.com/cubed-dev/cubed/pull/575
* Handle more memray allocation types by tomwhite in https://github.com/cubed-dev/cubed/pull/578
* Drop Python 3.9 by tomwhite in https://github.com/cubed-dev/cubed/pull/576
* QR decomposition by tomwhite in https://github.com/cubed-dev/cubed/pull/577
* Expose the `linalg` namespace and include in status page by tomwhite in https://github.com/cubed-dev/cubed/pull/581
* Fix outer result dtype by tomwhite in https://github.com/cubed-dev/cubed/pull/582
* Add new 2023.12 elemwise functions by tomwhite in https://github.com/cubed-dev/cubed/pull/583
* Bring vecdot implementation in line with the one in array-api-compat by tomwhite in https://github.com/cubed-dev/cubed/pull/402
* Zarr v3 now requires at least Python 3.11 by tomwhite in https://github.com/cubed-dev/cubed/pull/585
* Debug failing straggler test by tomwhite in https://github.com/cubed-dev/cubed/pull/580
* Set object codec for object arrays by tomwhite in https://github.com/cubed-dev/cubed/pull/573
* Fix for flaky straggler test by tomwhite in https://github.com/cubed-dev/cubed/pull/587
* Use `general_blockwise` in case of chunk-aligned selections in `index` by tomwhite in https://github.com/cubed-dev/cubed/pull/586
* Remove deprecated code by tomwhite in https://github.com/cubed-dev/cubed/pull/588
* Documentation small fixes by tomwhite in https://github.com/cubed-dev/cubed/pull/591
* Add page on optimization to user guide by tomwhite in https://github.com/cubed-dev/cubed/pull/397
* Remove old reduction implementation by tomwhite in https://github.com/cubed-dev/cubed/pull/589
* Add array API inspection utilities by tomwhite in https://github.com/cubed-dev/cubed/pull/592

New Contributors
* applio made their first contribution in https://github.com/cubed-dev/cubed/pull/554

**Full Changelog**: https://github.com/cubed-dev/cubed/compare/0.17.0...0.18.0

What's Changed
* Skip fewer array API tests by tomwhite in https://github.com/cubed-dev/cubed/pull/547
* Rechunk where dict has missing axes by tomwhite in https://github.com/cubed-dev/cubed/pull/546
* Adds logging [INFO] to `TimelineVisualizationCallback` and `HistoryCallback` by norlandrhagen in https://github.com/cubed-dev/cubed/pull/548
* More lenient dtype support by tomwhite in https://github.com/cubed-dev/cubed/pull/550
* Cast inputs to Cubed arrays in `apply_ufunc` by tomwhite in https://github.com/cubed-dev/cubed/pull/551
* Fix bug where `newaxis` with full slices doesn't add new axes by tomwhite in https://github.com/cubed-dev/cubed/pull/559
* Memray integration by tomwhite in https://github.com/cubed-dev/cubed/pull/558
* Add chunkmem to VirtualFullArray, which was missed in 447 by tomwhite in https://github.com/cubed-dev/cubed/pull/560
* Fix Array API Tests by tomwhite in https://github.com/cubed-dev/cubed/pull/562
* Memray callback by tomwhite in https://github.com/cubed-dev/cubed/pull/561
* Introduce FinalizedPlan by tomwhite in https://github.com/cubed-dev/cubed/pull/563
* Materialize arrays optimizer bugfix by tomwhite in https://github.com/cubed-dev/cubed/pull/564
* Align tqdm progress bars by tomwhite in https://github.com/cubed-dev/cubed/pull/567
* Coerce args to `map_blocks` to arrays by tomwhite in https://github.com/cubed-dev/cubed/pull/566
* Fail during planning if map_blocks drop_axis is for a chunked dimension by tomwhite in https://github.com/cubed-dev/cubed/pull/569
* Fix Rich progress bar flickering by limiting refreshes by tomwhite in https://github.com/cubed-dev/cubed/pull/571
* Allow Zarr compression to be set for intermediate files by tomwhite in https://github.com/cubed-dev/cubed/pull/572


**Full Changelog**: https://github.com/cubed-dev/cubed/compare/0.16.0...0.17.0

What's Changed
* Improve documentation around Array API support by tomwhite in https://github.com/cubed-dev/cubed/pull/477
* Speed up tests by JosepSampe in https://github.com/cubed-dev/cubed/pull/478
* Add normalize_shape since it is not in Zarr's public API by tomwhite in https://github.com/cubed-dev/cubed/pull/479
* Implement virtual array indexing using ndindex by tomwhite in https://github.com/cubed-dev/cubed/pull/441
* Ndindex indexing by tomwhite in https://github.com/cubed-dev/cubed/pull/481
* Pluggable backend storage by tomwhite in https://github.com/cubed-dev/cubed/pull/480
* Ensure integer arrays used for indexing are NumPy arrays by tomwhite in https://github.com/cubed-dev/cubed/pull/485
* Indicate that we support both 2021.12 and 2022.12 versions of the Array API by tomwhite in https://github.com/cubed-dev/cubed/pull/487
* TensorStore storage by tomwhite in https://github.com/cubed-dev/cubed/pull/483
* Update slides - June 2024 by tomwhite in https://github.com/cubed-dev/cubed/pull/489
* Fail with NotImplementedError if backend Zarr is missing nchunks_initialized by tomwhite in https://github.com/cubed-dev/cubed/pull/491
* Zarr v3 by tomwhite in https://github.com/cubed-dev/cubed/pull/484
* Remove print for local executors by tomwhite in https://github.com/cubed-dev/cubed/pull/506
* document what needs to be installed to run climatology anomaly example by rbavery in https://github.com/cubed-dev/cubed/pull/501
* Document how to run examples on local machine using `processes` by tomwhite in https://github.com/cubed-dev/cubed/pull/507
* Check `allowed_mem` does not exceed total on machine for `processes` executor by tomwhite in https://github.com/cubed-dev/cubed/pull/517
* Warn if peak mem exceeds `allowed_mem` by tomwhite in https://github.com/cubed-dev/cubed/pull/516
* Remove `max_tasks_per_child=1` limitation from processes executor by tomwhite in https://github.com/cubed-dev/cubed/pull/515
* Zarr Python v3 updates by tomwhite in https://github.com/cubed-dev/cubed/pull/523
* Modal progress fix by tomwhite in https://github.com/cubed-dev/cubed/pull/522
* Delete local context directories on exit by tomwhite in https://github.com/cubed-dev/cubed/pull/524
* Update demo notebooks by tomwhite in https://github.com/cubed-dev/cubed/pull/525
* Update CUBED_CONFIG path in example README.md by thodson-usgs in https://github.com/cubed-dev/cubed/pull/530
* Implement `flip` by tomwhite in https://github.com/cubed-dev/cubed/pull/528
* Add better test for local paths in `delete_on_exit` by tomwhite in https://github.com/cubed-dev/cubed/pull/532
* Deprecate `cubed.extensions` and move to `cubed.diagnostics` by tomwhite in https://github.com/cubed-dev/cubed/pull/533
* Turning on JAX tests for all PRs. by alxmrs in https://github.com/cubed-dev/cubed/pull/537
* Improve set-up instructions for examples by tomwhite in https://github.com/cubed-dev/cubed/pull/534
* Configuration documentation by tomwhite in https://github.com/cubed-dev/cubed/pull/535
* Adding `compile_function` as execute option. by alxmrs in https://github.com/cubed-dev/cubed/pull/536
* Diagnostics documentation by tomwhite in https://github.com/cubed-dev/cubed/pull/540

New Contributors
* JosepSampe made their first contribution in https://github.com/cubed-dev/cubed/pull/478
* rbavery made their first contribution in https://github.com/cubed-dev/cubed/pull/501
* thodson-usgs made their first contribution in https://github.com/cubed-dev/cubed/pull/530
* alxmrs made their first contribution in https://github.com/cubed-dev/cubed/pull/537

**Full Changelog**: https://github.com/cubed-dev/cubed/compare/0.15.0...0.16.0