What's Changed * POC: add tiffile serializer by robmarkcole in https://github.com/Lightning-AI/litdata/pull/425 * bump by robmarkcole in https://github.com/Lightning-AI/litdata/pull/427
What's Changed * fix: Add mechanism to inform the user a new version is available by tchaton in https://github.com/Lightning-AI/litdata/pull/420 * Version 0.2.32 by tchaton in https://github.com/Lightning-AI/litdata/pull/421
What's Changed * Multithreading function for merge_datasets by yhl48 in https://github.com/Lightning-AI/litdata/pull/413 * Change S3Client to use user-provided storage_options even in Studio by grez72 in https://github.com/Lightning-AI/litdata/pull/415 * Add missing interruptible argument for creating jobs by tchaton in https://github.com/Lightning-AI/litdata/pull/418
New Contributors * grez72 made their first contribution in https://github.com/Lightning-AI/litdata/pull/415
What's Changed * update tags in pkg metadata by Borda in https://github.com/Lightning-AI/litdata/pull/384 * 📝 Update Docs: Merge multiple optimized datasets into one by bhimrazy in https://github.com/Lightning-AI/litdata/pull/385 * Fix/large num chunks error by bhimrazy in https://github.com/Lightning-AI/litdata/pull/381 * fix: non-deterministic CI test failure by deependujha in https://github.com/Lightning-AI/litdata/pull/390 * correct the chunk size by adding header size by tchaton in https://github.com/Lightning-AI/litdata/pull/395 * pass storage options to s5cmd by bhimrazy in https://github.com/Lightning-AI/litdata/pull/397 * CONTRIBUTING.md for LitData by deependujha in https://github.com/Lightning-AI/litdata/pull/391 * Feat: add support for custom cache dir in Streaming Dataset by bhimrazy in https://github.com/Lightning-AI/litdata/pull/399 * 📝 docs: specify custom cache directory by bhimrazy in https://github.com/Lightning-AI/litdata/pull/405 * Fix broken link for CONTRIBUTING.md by bhimrazy in https://github.com/Lightning-AI/litdata/pull/404 * Feat/add support for numpy datatypes in tokensloader by bhimrazy in https://github.com/Lightning-AI/litdata/pull/401 * Bump version to 0.2.30 by bhimrazy in https://github.com/Lightning-AI/litdata/pull/410
What's Changed * Update `PL Data` to `LitData` by bhimrazy in https://github.com/Lightning-AI/litdata/pull/382 * Fix: Chunks deletion issue by deependujha in https://github.com/Lightning-AI/litdata/pull/375 * Bump version 0.2.29 by deependujha in https://github.com/Lightning-AI/litdata/pull/383