Litdata

What's Changed
* Multithreading function for merge_datasets by yhl48 in https://github.com/Lightning-AI/litdata/pull/413
* Change S3Client to use user-provided storage_options even in Studio by grez72 in https://github.com/Lightning-AI/litdata/pull/415
* Add missing interruptible argument for creating jobs by tchaton in https://github.com/Lightning-AI/litdata/pull/418

New Contributors
* grez72 made their first contribution in https://github.com/Lightning-AI/litdata/pull/415

**Full Changelog**: https://github.com/Lightning-AI/litdata/compare/v0.2.30...v0.2.31

What's Changed
* update tags in pkg metadata by Borda in https://github.com/Lightning-AI/litdata/pull/384
* 📝 Update Docs: Merge multiple optimized datasets into one by bhimrazy in https://github.com/Lightning-AI/litdata/pull/385
* Fix/large num chunks error by bhimrazy in https://github.com/Lightning-AI/litdata/pull/381
* fix: non-deterministic CI test failure by deependujha in https://github.com/Lightning-AI/litdata/pull/390
* correct the chunk size by adding header size by tchaton in https://github.com/Lightning-AI/litdata/pull/395
* pass storage options to s5cmd by bhimrazy in https://github.com/Lightning-AI/litdata/pull/397
* CONTRIBUTING.md for LitData by deependujha in https://github.com/Lightning-AI/litdata/pull/391
* Feat: add support for custom cache dir in Streaming Dataset by bhimrazy in https://github.com/Lightning-AI/litdata/pull/399
* 📝 docs: specify custom cache directory by bhimrazy in https://github.com/Lightning-AI/litdata/pull/405
* Fix broken link for CONTRIBUTING.md by bhimrazy in https://github.com/Lightning-AI/litdata/pull/404
* Feat/add support for numpy datatypes in tokensloader by bhimrazy in https://github.com/Lightning-AI/litdata/pull/401
* Bump version to 0.2.30 by bhimrazy in https://github.com/Lightning-AI/litdata/pull/410


**Full Changelog**: https://github.com/Lightning-AI/litdata/compare/v0.2.29...v0.2.30

What's Changed
* Update `PL Data` to `LitData` by bhimrazy in https://github.com/Lightning-AI/litdata/pull/382
* Fix: Chunks deletion issue by deependujha in https://github.com/Lightning-AI/litdata/pull/375
* Bump version 0.2.29 by deependujha in https://github.com/Lightning-AI/litdata/pull/383


**Full Changelog**: https://github.com/Lightning-AI/litdata/compare/v0.2.28...v0.2.29

What's Changed
* Revert "Feat: Using fsspec to download files" by tchaton in https://github.com/Lightning-AI/litdata/pull/380


**Full Changelog**: https://github.com/Lightning-AI/litdata/compare/v0.2.27...v0.2.28

What's Changed
* ci: drop dependabot by Borda in https://github.com/Lightning-AI/litdata/pull/361
* azure storage options by mohanreddypmr in https://github.com/Lightning-AI/litdata/pull/365
* switch `lightning-cloud` to lightning SDK by Borda in https://github.com/Lightning-AI/litdata/pull/369
* remove not violated bandit rules from ignore by Borda in https://github.com/Lightning-AI/litdata/pull/372
* fixing typos in errors & docs by Borda in https://github.com/Lightning-AI/litdata/pull/371
* reduce unnecessary `pass` by Borda in https://github.com/Lightning-AI/litdata/pull/373
* fixing docstrings by Borda in https://github.com/Lightning-AI/litdata/pull/374
* improve hint readability by Borda in https://github.com/Lightning-AI/litdata/pull/376
* Bump version to 0.2.27.dev by rasbt in https://github.com/Lightning-AI/litdata/pull/378
* fix import & asignement issue by Borda in https://github.com/Lightning-AI/litdata/pull/377
* Feat: Using fsspec to download files by deependujha in https://github.com/Lightning-AI/litdata/pull/348
* Bump version to 0.2.27 by bhimrazy in https://github.com/Lightning-AI/litdata/pull/379


**Full Changelog**: https://github.com/Lightning-AI/litdata/compare/v0.2.26...v0.2.27

What's Changed
* Bump mosaicml-streaming from 0.8.0 to 0.8.1 by dependabot in https://github.com/Lightning-AI/litdata/pull/346
* Adds check for existence of dataset path before loading index file by bhimrazy in https://github.com/Lightning-AI/litdata/pull/350
* Bump pypa/gh-action-pypi-publish from 1.9.0 to 1.10.0 by dependabot in https://github.com/Lightning-AI/litdata/pull/352
* Bump coverage from 7.5.3 to 7.6.1 by dependabot in https://github.com/Lightning-AI/litdata/pull/345
* bump/ci: update to `0.11.7` by Borda in https://github.com/Lightning-AI/litdata/pull/355
* Update README.md by tchaton in https://github.com/Lightning-AI/litdata/pull/356
* tchaton patch 1 by tchaton in https://github.com/Lightning-AI/litdata/pull/357
* Update README.md by tchaton in https://github.com/Lightning-AI/litdata/pull/358
* Update README.md by tchaton in https://github.com/Lightning-AI/litdata/pull/359
* Fix: Prevent multiple processes from copying the same file when using… by dallmann-uniwue in https://github.com/Lightning-AI/litdata/pull/353
* LitData release 0.2.26 by tchaton in https://github.com/Lightning-AI/litdata/pull/360

New Contributors
* dallmann-uniwue made their first contribution in https://github.com/Lightning-AI/litdata/pull/353

**Full Changelog**: https://github.com/Lightning-AI/litdata/compare/v0.2.25...v0.2.26