Deeplake

🧭 What's Changed
* libdeeplake update to fix memory issues (1927) AbhinavTuli
* [DL-777] Polygons bug fix (1922) farizrahman4u
* Variable local cache prefix (1839) GMW99
* [DL-763] Locking fix (1921) farizrahman4u
* [DL-701] Columnar views (1912) farizrahman4u
⚙️ Who Contributes
AbhinavTuli, GMW99 and farizrahman4u

🧭 What's Changed
* Updated libdeeplake version, removes torch as dependency, fixes issue with strings in dataloader (1919) AbhinavTuli
* [DL-753] [DL-722] Fix appending linked data with verify=False (1914) FayazRahman
* Allow tensorflow dataset to fetch chunks (1887) daniel-falk
* [DL-754] Add reporting for W&B integration (1918) FayazRahman
⚙️ Who Contributes
AbhinavTuli, FayazRahman, daniel-falk, davidbuniat and mikayelh

🧭 What's Changed
* Update libdeeplake version to fix issue with distributed mode (1915) AbhinavTuli
* [AL-1967] Fixes issue with readonly mode error raised despite not trying to write to dataset (1911) AbhinavTuli
⚙️ Who Contributes
AbhinavTuli and davidbuniat

Introducing Deep Lake

We are more than excited to transition into Deep Lake, data lake for deep learning applications. Furthermore we released

- an academic paper describing all technical details https://arxiv.org/pdf/2209.10785.pdf.
- business white paper you can find on https://deeplake.ai
- We also move the api reference to https://docs.deeplake.ai/en/latest/

Behind the scenes those are 5 key stepping stones of Deep Lake.

1. **Version Control**: Git for data
2. **Visualize**: In-browser visualization engine
3. **Query**: Rapid queries with Tensor Query language
4. **Materialize**: Format native to deep learning
5. **Stream**: Streaming Data Loaders

If you wonder...

- Why we renamed Hub to Deep Lake?

Hub originally was a chunked array format which evolved with version control, streaming engine, query capabilities naturally while iterating with community members. The name has been too generic to describe the tool often leading to a confusion with dataset hubs. Inspired from A. Pinhassi’s blogpost we renamed the package from hub to deeplake

python
> pip3 install deeplake


- Where does Deep Lakehouse comes into the place?

While the format including versioning, lineage is fully open-source. Query, streaming and visualization engines built in C++ are yet closed source. They are accessible through Python interface for all users. While committed to open-source principles, we are planning to open-source high performance engines as they commoditize.


🧭 What's Changed
* Update README.zh-cn.md (1910) tatevikh
* Update README.md (1909) istranic
* Staging 3.0.5 (1908) farizrahman4u
* Tiling Fix (1907) farizrahman4u
* 3.0.3 (1906) farizrahman4u
* [DL-746] hub->deeplake (1895) farizrahman4u
* [DL-747] API Reference updates: new compressions + new Htypes page (1892) FayazRahman
* Tensor Query Language documentation (1896) FayazRahman
* Added more file formats for compression (1597) aadityasinha-dotcom
* Indra import fix (1891) farizrahman4u
* API Reference updates (1886) FayazRahman
* Update version to 2.8.6 (1889) AbhinavTuli

🐛 Bug Fixes

* Passing token down (1903) ProgerDav
⚙️ Who Contributes
AbhinavTuli, FayazRahman, ProgerDav, aadityasinha-dotcom, artgish, davidbuniat, farizrahman4u, istranic, mikayelh and tatevikh

🧭 What's Changed
* [DL-717] Add installation instructions to API reference (1882) FayazRahman
* [DL-702] API reference updates (1883) FayazRahman
* [DL-711] Allow view optimization when read_only=True (1865) farizrahman4u
* Fixes bug with is_sequence (1880) AbhinavTuli
* [DL-714] Add Ellipsis support for indexing (1878) farizrahman4u
* [DL-645] Fix memory leak in transforms (1871) adolkhan
* [DL-715] Fix wandb integration path issue (1879) farizrahman4u
* Add docstrings for experimental features(1876) levongh
* [DL-693] Disable label sync for dataset copy transform (1875) FayazRahman
* [DL-709] Docker build fix (1860) farizrahman4u
* Improve indra error message in case of missing dependencies (1873) farizrahman4u
* [DL-710] Fix locking issue with deepcopy (1864) farizrahman4u
⚙️ Who Contributes
AbhinavTuli, FayazRahman, adolkhan, davidbuniat, farizrahman4u and levongh

🧭 What's Changed
* Fixes import issue on Python 3.10 (1867) adolkhan
* Big speedup for experimental dataloader initialization (1869) AbhinavTuli
* Adds docstrings for experimenal features (1868) levongh
⚙️ Who Contributes
AbhinavTuli, FayazRahman, adolkhan, davidbuniat and levongh