Xorbits

What's new in 0.6.0 (2023-09-08)
These are the changes in xorbits v0.6.0.
New features
* FEAT: support loading zip file for read_parquet by YibinLiu666 in https://github.com/xorbitsai/xorbits/pull/662
Enhancements
* ENH: Use memoryview to open reader in MMAP storage backend by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/675
* ENH: Compatible with Pandas 2.1.0 by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/679
* ENH: Improve use_arrow_dtype for pandas 2.0+ by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/580
* ENH: Default enable arrow dtype for read_parquet if pandas>=2.1 by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/685
Bug fixes
* BUG: ipython data missing columns due to column pruning by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/681
Documentation
* DOC: Readme for tpch benchmark script by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/676
Others
* Add support to import xorbits.numpy.special functions by luweizheng in https://github.com/xorbitsai/xorbits/pull/683
* CHORE: Fix Pandas <= 2.0.3 for now by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/678
* CHORE: fsspec as dependency by aresnow1 in https://github.com/xorbitsai/xorbits/pull/686


**Full Changelog**: https://github.com/xorbitsai/xorbits/compare/v0.5.2...v0.6.0

What's new in 0.5.2 (2023-08-30)
These are the changes in xorbits v0.5.2.
New features
* FEAT: MMAP storage backend by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/674
Enhancements
* ENH: Use arrow table to transfer dataset meta by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/663
Bug fixes
* BUG: Fix dtypes of `pd.pivot_table` by aresnow1 in https://github.com/xorbitsai/xorbits/pull/668
* BUG: Fix tpch by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/670
Tests
* TST: Add test_put_get_arrow by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/656
Others
* CHORE: Modify required reviews by aresnow1 in https://github.com/xorbitsai/xorbits/pull/665
* CHORE: disable infer_datetime_format option to reduce warnings by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/673


**Full Changelog**: https://github.com/xorbitsai/xorbits/compare/v0.5.1...v0.5.2

What's new in 0.5.1 (2023-08-14)
These are the changes in xorbits v0.5.1.
New features
* FEAT: Export dataset by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/639
* FEAT: Iterable dataset by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/643
Enhancements
* ENH: Compatible with scikit-learn 1.3.0 by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/648
* BLD: fix docker build on python 3.11 by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/642
* BLD: add datasets dependency in docker base image by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/644
* BLD: git reset to fix dirty tag by aresnow1 in https://github.com/xorbitsai/xorbits/pull/655
* BLD: Fix source building by aresnow1 in https://github.com/xorbitsai/xorbits/pull/657
* BLD: Fix uploading wheel when it exists by aresnow1 in https://github.com/xorbitsai/xorbits/pull/658
Bug fixes
* BUG: Fix Huggingface dataset loader filelock conflict by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/633
* BUG: Fix pre-commit arg and CI node version by Flying-Tom in https://github.com/xorbitsai/xorbits/pull/622
* BUG: Fix missing ArrowDtype by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/641
* BUG: Fix `_generate_value` when building mock dataframe by aresnow1 in https://github.com/xorbitsai/xorbits/pull/645
* BUG: Fix issues when connecting to a real yarn cluster by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/647
Tests
* TST: K8s with juicefs CI may leads to pv conflict by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/646
Others
* Fix copyright by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/651
* CHORE: Remove win32 support by aresnow1 in https://github.com/xorbitsai/xorbits/pull/652


**Full Changelog**: https://github.com/xorbitsai/xorbits/compare/v0.5.0...v0.5.1

What's new in 0.5.0 (2023-07-28)
These are the changes in xorbits v0.5.0.
New features
* FEAT: Basic datasets feature by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/600
* FEAT: Raise clearer errors when encountering OOM by Flying-Tom in https://github.com/xorbitsai/xorbits/pull/621
* Feat: Basic datasets getitem by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/628
Enhancements
* ENH: add dedup method by Hank0626 in https://github.com/xorbitsai/xorbits/pull/617
Bug fixes
* BUG: Fix `pd.read_csv` with encoding parameter by aresnow1 in https://github.com/xorbitsai/xorbits/pull/614
* BUG: fix from_tensor by Hank0626 in https://github.com/xorbitsai/xorbits/pull/625
* BUG: fix drop_duplicates no dtypes by Hank0626 in https://github.com/xorbitsai/xorbits/pull/627
Tests
* TST: Fix asv benchmark by aresnow1 in https://github.com/xorbitsai/xorbits/pull/624
Documentation
* DOC: Add best practice for loading data by aresnow1 in https://github.com/xorbitsai/xorbits/pull/620
* Doc: Datasets doc by codingl2k1 in https://github.com/xorbitsai/xorbits/pull/619
Others
* CHORE: add msbuild to CI by YibinLiu666 in https://github.com/xorbitsai/xorbits/pull/631

New Contributors
* Flying-Tom made their first contribution in https://github.com/xorbitsai/xorbits/pull/621

**Full Changelog**: https://github.com/xorbitsai/xorbits/compare/v0.4.4...v0.5.0

What's new in 0.4.4 (2023-07-21)
These are the changes in xorbits v0.4.4.
New features
* FEAT: add xorbits experimental by Hank0626 in https://github.com/xorbitsai/xorbits/pull/611
Enhancements
* ENH: Optimize graph fusion by aresnow1 in https://github.com/xorbitsai/xorbits/pull/609
Bug fixes
* BUG: fix s3 glob by Hank0626 in https://github.com/xorbitsai/xorbits/pull/612


**Full Changelog**: https://github.com/xorbitsai/xorbits/compare/v0.4.3...v0.4.4

What's new in 0.4.3 (2023-07-20)
These are the changes in xorbits v0.4.3.
New features
* FEAT: support text dedup by Hank0626 in https://github.com/xorbitsai/xorbits/pull/576
Enhancements
* ENH: Support xoscar copy_to by ChengjieLi28 in https://github.com/xorbitsai/xorbits/pull/582
Bug fixes
* BUG: Fix Read Parquet by Hank0626 in https://github.com/xorbitsai/xorbits/pull/590
* BUG: Fix LGBM CI by Hank0626 in https://github.com/xorbitsai/xorbits/pull/599
* BUG: Fetch to local when print object data by aresnow1 in https://github.com/xorbitsai/xorbits/pull/598
* BUG: Fix compatibility with the newest lightgbm by yifeis7 in https://github.com/xorbitsai/xorbits/pull/601
Others
* Bump semver from 5.7.1 to 5.7.2 in /python/xorbits/web/ui by dependabot in https://github.com/xorbitsai/xorbits/pull/594
* Bump word-wrap from 1.2.3 to 1.2.4 in /python/xorbits/web/ui by dependabot in https://github.com/xorbitsai/xorbits/pull/606


**Full Changelog**: https://github.com/xorbitsai/xorbits/compare/v0.4.2...v0.4.3