Deeplake

🧭 What's Changed
* added improvements and regressions as artifacts (1255) gautamkrishnar
* Fixes empty samples in hub compute (1269) AbhinavTuli
* [2 liner] TorchDataset.__len__ (1268) mccrearyd
* Fix creating nested tensor from non-head node (1261) FayazRahman
* fix text not working for transforms (1258) mccrearyd
* [Tiny] Updated htype docstring for segment mask (1264) istranic
* Added coco_keypoint htype and changed default dtype for segment masks (1262) istranic
* Groups perf fix (1212) farizrahman4u
* Jpeg: External test images repo + small fixes (1249) farizrahman4u
* Json, List, Text (1214) farizrahman4u
* fix pytest dependency error (1254) mccrearyd
* PNG compression for arbitrary number of channels (1252) farizrahman4u
* [tiny] tqdm progress bar for pytorch (1243) mccrearyd

🔗 Dependency Updates

* Bump pillow from 8.2.0 to 8.3.2 in /hub/requirements (1151) dependabot
⚙️ Who Contributes
AbhinavTuli, FayazRahman, davidbuniat, dependabot, farizrahman4u, gautamkrishnar, istranic and mccrearyd

🧭 What's Changed
* Fix segmentation fault (1248) aliubimov
* added pull_request_target check (1246) gautamkrishnar
* removed repository name from pr checks (1245) gautamkrishnar
* Added reporting to ingest, ingest_kaggle, and list (1242) istranic
* PyTorch & Tensorflow aliases for datasets (1238) muhdhisham
* added manual benchmarking for hub baseline (1224) gautamkrishnar
* Added benchmarking workflow to hub pull requests (1218) gautamkrishnar
* Fix/sagemaker creds (1204) AbhinavTuli
* Fix Getting Started link (1237) aliubimov
* Fix VC test (1233) farizrahman4u
* Add flac and wav support (1220) FayazRahman
* Fix pickle5 issue (1230) AbhinavTuli
* Fix grayscale tests (1222) farizrahman4u
* Fixes issues with kaggle tests after audio merge (1231) AbhinavTuli
* Beautify meta .json files (1229) jakbin
* Update README.md (1194) istranic
* Audio (1207) farizrahman4u
* Bring back "Linux Timple Test" (1203) Diveafall
* AL-1368 Handle grayscale image after color image (1206) jraman
* Added reporting for version control (1209) istranic
* [tiny] Update error messages (1211) mccrearyd
* Distributed computation with ray (1140) AbhinavTuli
* Revert "Adding shared memory support for Pytorch 3.6/3.7, speeding up pytorch integration" (1210) AbhinavTuli
* AL-1433 List compression types for hub.compression (1208) jraman
* Adding shared memory support for Pytorch 3.6/3.7, speeding up pytorch integration (1196) AbhinavTuli
* lz4 backward compatibility (1201) FayazRahman
* Update docs for hub.ingest (1199) jraman
* Removing "Linux Simple Test" from all workflows (1198) Diveafall
* Change lz4 implementation to numcodecs (1197) FayazRahman
* Revert "PyTorch & Tensorflow aliases for datasets" (1195) mccrearyd
* PyTorch & Tensorflow aliases for datasets (1183) muhdhisham
⚙️ Who Contributes
AbhinavTuli, Diveafall, FayazRahman, aliubimov, davidbuniat, farizrahman4u, gautamkrishnar, istranic, jakbin, jraman, mccrearyd, mikayelh, muhdhisham and tatevikh

🩰 What's New
* Added hierarchical datasets (tensor groups)
* Added support for Google Cloud Storage (`path = gcs://...`)
* Added version control alpha
🧭 What's Changed
* Fix version control speed for first commit (1192) AbhinavTuli
* Missing compressions fix (1191) farizrahman4u
* Tensor group fixes (1190) farizrahman4u
* gcs path fix (1188) davidbuniat
* Version Control (1152) AbhinavTuli
* One more jpg fix (1186) farizrahman4u
* fix running tests fails when no gcs creds exist (1187) mccrearyd
* Istranic update readme (1185) istranic
* GCS support (1125) kristinagrig06
* [Small] Fixes logging (1153) AbhinavTuli
* Modify dataset privacy (1141) kristinagrig06
* Imagenet weird jpegs fix (1155) farizrahman4u
* Hierarchical Tensors (1139) farizrahman4u
* [small] client/utils.py: Dont sys.exit on Bad request (1154) farizrahman4u
* Add Tensor to API reference (1146) kristinagrig06
* [small-Please approve] fix typo (1144) thisiseshan
⚙️ Who Contributes
AbhinavTuli, davidbuniat, farizrahman4u, istranic, kristinagrig06, mccrearyd, tatevikh and thisiseshan

🧭 What's Changed
* Multi - SOF jpeg fix (1134) farizrahman4u
* Pytorch shuffling (1122) AbhinavTuli
* DS locking: atexit release (1138) farizrahman4u
* Treat size 1 arrays as scalars when casting (1135) farizrahman4u
* Tensor inplace ops (1136) farizrahman4u
* Small fix (1133) farizrahman4u
* Faster deserialization (1131) farizrahman4u
* hub.read speedup (4x) (1126) farizrahman4u
* Delete .from_path() method (1128) kristinagrig06
* [small] better error messages + fix ingest_kaggle (1132) mccrearyd
* DS lock fix (1129) farizrahman4u
* auto refinement (1124) thisiseshan
* Chunk-wise compression (1093) farizrahman4u
* Ingestion summary (1117) thisiseshan
* hub.read speed up (>6X) (1120) farizrahman4u
* Dataset locking (1119) farizrahman4u
* Backward compat fix (1121) farizrahman4u
* backwards compatibility (and CI tests!) (1110) mccrearyd
* fix pytorch tests chunk sizes + max_chunk_size in `create_tensor` (1114) mccrearyd
* Auto compression (1109) thisiseshan
* add --kaggle functionality (1108) thisiseshan
* Fixes an issue with pytorch old read only (1113) AbhinavTuli
* Add Dataset functions to docs (1098) kristinagrig06
* [small] `hub.htypes` is a list of all htypes (1104) mccrearyd
⚙️ Who Contributes
AbhinavTuli, davidbuniat, farizrahman4u, kristinagrig06, mccrearyd, tatevikh and thisiseshan

🧭 What's Changed
* Fix/num workers 0 bug (1112) davidbuniat
* Move hub.compute reporting to pipeline eval (1116) istranic
* Updates transform docstrings/variables to remove usage of the word "transform" (1115) AbhinavTuli
* Fixed bugout reporting paths and overreporting during Dataset initialization. (1111) davidbuniat

🩰 What's New
* Added hub.ingest for automatic creation of datasets
* Added hub.list to help users find publicly available datasets
* Lots of refactors to help developers
🧭 What's Changed
* kaggle argument fix (1101) thisiseshan
* Polish top directory (1054) kristinagrig06
* Ban dataset attributes as tensor names (1103) kristinagrig06
* update tensors (1089) mccrearyd
* More sample compressions (1087) farizrahman4u
* [small] all scalars have shape (1,) instead of () (1102) mccrearyd
* refactor input pipeline for samples (1099) mccrearyd
* Integrate hub auto + kaggle (1075) thisiseshan
* List datasets (1048) kristinagrig06
⚙️ Who Contributes
AbhinavTuli, farizrahman4u, kristinagrig06, mccrearyd and thisiseshan