Deeplake

🧭 What's Changed
* Update libdeeplake version to fix issue with distributed mode (1915) AbhinavTuli
* [AL-1967] Fixes issue with readonly mode error raised despite not trying to write to dataset (1911) AbhinavTuli
⚙️ Who Contributes
AbhinavTuli and davidbuniat

Introducing Deep Lake

We are more than excited to transition into Deep Lake, data lake for deep learning applications. Furthermore we released

- an academic paper describing all technical details https://arxiv.org/pdf/2209.10785.pdf.
- business white paper you can find on https://deeplake.ai
- We also move the api reference to https://docs.deeplake.ai/en/latest/

Behind the scenes those are 5 key stepping stones of Deep Lake.

1. **Version Control**: Git for data
2. **Visualize**: In-browser visualization engine
3. **Query**: Rapid queries with Tensor Query language
4. **Materialize**: Format native to deep learning
5. **Stream**: Streaming Data Loaders

If you wonder...

- Why we renamed Hub to Deep Lake?

Hub originally was a chunked array format which evolved with version control, streaming engine, query capabilities naturally while iterating with community members. The name has been too generic to describe the tool often leading to a confusion with dataset hubs. Inspired from A. Pinhassi’s blogpost we renamed the package from hub to deeplake

python
> pip3 install deeplake


- Where does Deep Lakehouse comes into the place?

While the format including versioning, lineage is fully open-source. Query, streaming and visualization engines built in C++ are yet closed source. They are accessible through Python interface for all users. While committed to open-source principles, we are planning to open-source high performance engines as they commoditize.


🧭 What's Changed
* Update README.zh-cn.md (1910) tatevikh
* Update README.md (1909) istranic
* Staging 3.0.5 (1908) farizrahman4u
* Tiling Fix (1907) farizrahman4u
* 3.0.3 (1906) farizrahman4u
* [DL-746] hub->deeplake (1895) farizrahman4u
* [DL-747] API Reference updates: new compressions + new Htypes page (1892) FayazRahman
* Tensor Query Language documentation (1896) FayazRahman
* Added more file formats for compression (1597) aadityasinha-dotcom
* Indra import fix (1891) farizrahman4u
* API Reference updates (1886) FayazRahman
* Update version to 2.8.6 (1889) AbhinavTuli

🐛 Bug Fixes

* Passing token down (1903) ProgerDav
⚙️ Who Contributes
AbhinavTuli, FayazRahman, ProgerDav, aadityasinha-dotcom, artgish, davidbuniat, farizrahman4u, istranic, mikayelh and tatevikh

🧭 What's Changed
* [DL-717] Add installation instructions to API reference (1882) FayazRahman
* [DL-702] API reference updates (1883) FayazRahman
* [DL-711] Allow view optimization when read_only=True (1865) farizrahman4u
* Fixes bug with is_sequence (1880) AbhinavTuli
* [DL-714] Add Ellipsis support for indexing (1878) farizrahman4u
* [DL-645] Fix memory leak in transforms (1871) adolkhan
* [DL-715] Fix wandb integration path issue (1879) farizrahman4u
* Add docstrings for experimental features(1876) levongh
* [DL-693] Disable label sync for dataset copy transform (1875) FayazRahman
* [DL-709] Docker build fix (1860) farizrahman4u
* Improve indra error message in case of missing dependencies (1873) farizrahman4u
* [DL-710] Fix locking issue with deepcopy (1864) farizrahman4u
⚙️ Who Contributes
AbhinavTuli, FayazRahman, adolkhan, davidbuniat, farizrahman4u and levongh

🧭 What's Changed
* Fixes import issue on Python 3.10 (1867) adolkhan
* Big speedup for experimental dataloader initialization (1869) AbhinavTuli
* Adds docstrings for experimenal features (1868) levongh
⚙️ Who Contributes
AbhinavTuli, FayazRahman, adolkhan, davidbuniat and levongh

🧭 What's Changed
* Fixes type mismatch for expiration(1858) levongh
* Flag to disable wandb integration (1863) farizrahman4u
* Fixes wandb+local datasets (1861) hakanardo
* [DL-668] Make pytorch() work with views (1855) farizrahman4u
* [AL-1949] Make experimental pytorch dataloader consistent with existing implementation (1853) AbhinavTuli
* [DL-650] Better error handling when not passing a tensor name to ds.append (1817) adolkhan
* Update docs URL in readme (1857) FayazRahman
* Speedup conversion of hub storage datasets->deeplake for experimental features (1856) levongh
* [DL-611] New API reference (1830) FayazRahman
* Wandb update: report datasets created with deepcopy (1848) farizrahman4u
* [Bugfix] 1828 raising UserNotLoggedInException when invalid path is provided (1829) adolkhan
* [DL-655] Added min and max length options (1841) adolkhan
⚙️ Who Contributes
AbhinavTuli, FayazRahman, adolkhan, davidbuniat, farizrahman4u, hakanardo and levongh

🧭 What's Changed
* Ensure that new format for chunk id isn't used for encoders with version <= 2.7.6 (1850) AbhinavTuli
⚙️ Who Contributes
AbhinavTuli and davidbuniat