Hub

🚀 New
* Auto infer-schema & auto-directory ingestion! (696) McCrearyD
* Added a hello objectron notebook (694) haiyangdeperci
* Added ability to specify region in S3 (715) kevinlu1211
* CSV parsing added to hub.auto (711) dhiganthrao
* Added genomelake hub backend benchmarks (680) DebadityaPal
* Added unit test for utils.py (668) hakanbakacak

🧭 What's Changed
* to_tensorflow now supports a new argument (key_list) that only passes certain tensors to it and speeds up iteration time in case multiple extra tensors are present. (689) AbhinavTuli
* Caching present within to_tensorflow has been improved to tensors with dynamic shapes (earlier it was saving only the current sample in the cache) (689) AbhinavTuli
* Adds the option to specify None as compressor while defining the schema (689) AbhinavTuli
* Adds the ability to slice dynamically shaped tensors and obtain a list instead of iterating over them one by one. (689) AbhinavTuli
* transform logic has been modified to work properly with multiple workers (689) AbhinavTuli
* Added tags to usage and crash reports (697) zomglings
* Added ipynb file with benchmark tests for dnafrag package (676) DebadityaPal
* Relaxed hub requirements (659) haiyangdeperci
* Updated Objectron dataset tensors from generic types to hub schema representations (705) haiyangdeperci


🐛 Bug Fixes
* Removed mutable default args in client/base.py (699) TakshPanchal
* Fixes windows environment encoding (671) haiyangdeperci
* Fix/windows setup (650) haiyangdeperci
* Fixed README links (682) DebadityaPal
* Any dataset copy test that got interrupted midway through the test affected all subsequent test runs. This has now been fixed. (689) AbhinavTuli
* Fixed issue with resize in mode='a' (718) kristinagrig06


🗂 Documentation
* Russian translation for README (656) george-zakharov
* Update schema docs (654) thisiseshan
* Add Tutorial for Working with Text on Hub (672) dhiganthrao
* include consent language in readme (666) mynameisvinn

🔗 Dependency Updates
* Bumped humbug dependency version to ">=0.1.6" (673) zomglings
* Update zarr requirement from <2.7,>=2.4 to >=2.4,<2.8 (717) dependabot-preview
* Bump boto3 from 1.17.33 to 1.17.36 (716) dependabot-preview
* Bump boto3 from 1.17.30 to 1.17.33 (701) dependabot-preview
* Bump tensorflow from 2.4.0 to 2.4.1 (706) dependabot-preview
* Bump sphinx from 3.5.2 to 3.5.3 (707) dependabot-preview
* Bump tiledb from 0.7.6 to 0.8.5 (703) dependabot-preview
* Bump flake8 from 3.8.4 to 3.9.0 (686) dependabot-preview
* [Security] Bump tensorflow from 2.3.1 to 2.4.0 (332) dependabot-preview
* Bump pytest-cov from 2.10.1 to 2.11.1 (474) dependabot-preview
* Bump boto3 from 1.17.22 to 1.17.30 (693) dependabot-preview
⚙️ Who Contributed
AbhinavTuli, DebadityaPal, McCrearyD, TakshPanchal, dependabot-preview, dependabot-preview[bot], dhiganthrao, george-zakharov, haiyangdeperci, hakanbakacak, kevinlu1211, kristinagrig06, madhucharan, mynameisvinn, thisiseshan, zomglings

🚀 New
* Auto infer-schema & auto-directory ingestion! (696) McCrearyD
* Added a hello objectron notebook (694) haiyangdeperci
* Added ability to specify region in S3 (715) kevinlu1211
* CSV parsing added to hub.auto (711) dhiganthrao
* Added genomelake hub backend benchmarks (680) DebadityaPal
* Added unit test for utils.py (668) hakanbakacak

🧭 What's Changed
* to_tensorflow now supports a new argument (key_list) that only passes certain tensors to it and speeds up iteration time in case multiple extra tensors are present. (689) AbhinavTuli
* Caching present within to_tensorflow has been improved to tensors with dynamic shapes (earlier it was saving only the current sample in the cache) (689) AbhinavTuli
* Adds the option to specify None as compressor while defining the schema (689) AbhinavTuli
* Adds the ability to slice dynamically shaped tensors and obtain a list instead of iterating over them one by one. (689) AbhinavTuli
* transform logic has been modified to work properly with multiple workers (689) AbhinavTuli
* Added tags to usage and crash reports (697) zomglings
* Added ipynb file with benchmark tests for dnafrag package (676) DebadityaPal
* Relaxed hub requirements (659) haiyangdeperci
* Updated Objectron dataset tensors from generic types to hub schema representations (705) haiyangdeperci


🐛 Bug Fixes
* Removed mutable default args in client/base.py (699) TakshPanchal
* Fixes windows environment encoding (671) haiyangdeperci
* Fix/windows setup (650) haiyangdeperci
* Fixed README links (682) DebadityaPal
* Any dataset copy test that got interrupted midway through the test affected all subsequent test runs. This has now been fixed. (689) AbhinavTuli
* Fixed issue with resize in mode='a' (718) kristinagrig06


🗂 Documentation
* Russian translation for README (656) george-zakharov
* Update schema docs (654) thisiseshan
* Add Tutorial for Working with Text on Hub (672) dhiganthrao
* include consent language in readme (666) mynameisvinn

🔗 Dependency Updates
* Bumped humbug dependency version to ">=0.1.6" (673) zomglings
* Update zarr requirement from <2.7,>=2.4 to >=2.4,<2.8 (717) dependabot-preview
* Bump boto3 from 1.17.33 to 1.17.36 (716) dependabot-preview
* Bump boto3 from 1.17.30 to 1.17.33 (701) dependabot-preview
* Bump tensorflow from 2.4.0 to 2.4.1 (706) dependabot-preview
* Bump sphinx from 3.5.2 to 3.5.3 (707) dependabot-preview
* Bump tiledb from 0.7.6 to 0.8.5 (703) dependabot-preview
* Bump flake8 from 3.8.4 to 3.9.0 (686) dependabot-preview
* [Security] Bump tensorflow from 2.3.1 to 2.4.0 (332) dependabot-preview
* Bump pytest-cov from 2.10.1 to 2.11.1 (474) dependabot-preview
* Bump boto3 from 1.17.22 to 1.17.30 (693) dependabot-preview
⚙️ Who Contributed
AbhinavTuli, DebadityaPal, McCrearyD, TakshPanchal, dependabot-preview, dependabot-preview[bot], dhiganthrao, george-zakharov, haiyangdeperci, hakanbakacak, kevinlu1211, kristinagrig06, madhucharan, mynameisvinn, thisiseshan, zomglings

🧭 What's Changed
1. Version Control has been added to Hub Datasets! (610) AbhinavTuli
2. to_tensorflow now properly supports Text datasets (658) AbhinavTuli
3. Hub crash and system information reports using Bugout (624) zomglings
4. Added support for multiple BBox and Classlabel, instead of Sequences. (658) AbhinavTuli
5. CLI name has been changed from hub to activeloop (631) haiyangdeperci
6. Notebook example for creating dataset for object detection and instance segmentation added(629) haritsahm
7. Tutorial for working with Audio Added (592) mynameisvinn


🚀 New
1. Hub version command cli (628) sparkingdark
2. Automatic Release Drafter added to repository (598) Anselmoo
3. Improve Directory Structure of Examples (630) SauravMaheshkar
4. Put zarr, tileDB, and hub benchmarks in one file (534) DebadityaPal
5. Refactored Dataset Class (576) DebadityaPal
6. Add Github Actions CI pipeline (372) ADI10HERO
7. Improve Directory Structure of Examples (630) SauravMaheshkar


🐛 Bug Fixes
1. Removed Assertions from shape_detector.py and added exceptions (616) DebadityaPal
2. Adds support for dataset views in sharded dataset (557) AbhinavTuli
3. Advanced slicing added for Sharded Dataset (558) AbhinavTuli


🗂 Documentation
1. README added in Korean (621) HyeongminLEE
2. README added in Bahasa Indonesia (645) haritsahm
3. README added in French (640) MargauxMasson
4. README added in Turkish (608) hakanbakacak
5. Chinese Readme Proofread and Update (613) Cynthia7979
6. Change ds.commit() to ds.flush() throughout in README.md (619) galbwe
7. Added explaination for local file system to docs (634) McCrearyD
8. Replaced commit() with flush() in documentation. (604) dhiganthrao
9. Add MinIO to Data Storage docs (605) gabriel-milan
10. Updated example notebooks with pip (585) MojammelHossain
11. Typos fixed (591) dPacc

🔗 Dependency Updates
Bump pytest from 6.2.1 to 6.2.2 (496) dependabot-preview
Bump ray from 1.0.0 to 1.2.0 (554) dependabot-preview
Bump boto3 from 1.16.39 to 1.17.20 (646) dependabot-preview
⚙️ Who Contributed
ADI10HERO, AbhinavTuli, Anselmoo, Cynthia7979, DebadityaPal, HyeongminLEE, MargauxMasson, McCrearyD, MojammelHossain, SauravMaheshkar, dPacc, davidbuniat, dhiganthrao, gabriel-milan, galbwe, haiyangdeperci, hakanbakacak, haritsahm, imshashank, mikayelh, mynameisvinn, sparkingdark and zomglings

Release Notes

1. Reverting shape checks for Mask schema to maintain backward compatibility.

Release Notes
1. Hotfix for a bug that resulted in incorrect slicing of TensorView.

Release Notes
1. Dataset copying has been added allowing you to copy your own and other users' datasets easily. Datasets can be copied across gcs, s3, aws, local storage and hub storage. 454 (AbhinavTuli)
2. Many improvements to the benchmarks 508 512 531 545 550 (haiyangdeperci DebadityaPal)
3. Development Roadmap added 511 (mynameisvinn)
4. Improved message for Hub transforms by displaying shard size 523 (DebadityaPal)
5. All windows have now been fixed. 528 (AbhinavTuli)
6. Hub dataset filtering has been overhauled and a section has been added for the same in the documentation 539 (AbhinavTuli)
7. to_tensorflow issues with Datasets containing Sequences (such as coco) have been fixed 540 (AbhinavTuli)
8. Adds get_label parameter to .compute() and .numpy(), to directly retrieve string label from ClassLabel 489 (DebadityaPal)
9. Tutorial added for using Hub with Hugging Face transformers 536 (DebadityaPal)
10. Some unit tests have now been parameterized to cover multiple datatypes 527 (drewpotter)
11. From directory function has been implemented to directly ingest categorical image data 459 (sparkingdark)
12. Example use case added for creating a Hub dataset for Deep Learning prediction of crop yield 559 (MargauxMasson)
13. MPL Headers have been added to source files 494 (KrishnaChaitanya1)