Lakefs-spec

🚨 Breaking Changes

This release marks the end of support for Python 3.9 (and earlier), which has reached end-of-life status with the release of Python 3.13.

What's Changed
* Update project lockfiles and pre-commit setup by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/287
* Bump oldest supported Python to 3.10 by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/288
* [ci] Update CI workflow to be based on uv toolchain by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/289
* Run pre-commit autoupdate again by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/290
* Support `fs.exists()` on repo root by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/292


**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.10.0...v0.11.0

This release fixes a case in which users attempting to bulk-delete more than 1000 objects would get errors from the lakeFS server. From now on, object deletes are carried out in batches of 1000, which is the maximum that the server handles.

What's Changed
* Update lockfiles for CI and dev setups by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/281
* Batch objects in `Branch.delete_objects` calls by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/285
* Add rm test on more than 1000 files by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/286


**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.9.0...v0.10.0

This release increases the minimum required fsspec version to `fsspec>=2023.12.0` (December 2023). It does not contain changes in functionality.

What's Changed
* Bump minimum fsspec version to 2023.12.0 by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/280
* Update pre-commit hooks, change lockfile to use uv pip compile by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/278


**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.8.0.post0...v0.9.0

This release adds example code showing how to access lakeFS repositories from the [Hugging Face 🤗 Datasets](https://huggingface.co/docs/datasets/index) library to the documentation.

What's Changed
* Docs: Demonstrate integration of Hugging Face Datasets by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/275
* Bump linter dependencies by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/276


**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.8.0...v0.8.0.post0

This release changes the behavior of `LakeFSFileSystem.exists()` when encountering a `CommonPrefix`, which is lakeFS' directory abstraction. Afterwards, the file system can detect existing directories/common prefixes on a branch, returning `True` for any existing directories.

What's Changed
* Update outdated CI actions by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/269
* Update pre-commit hooks by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/270
* Fixed broken URL in README.md by leonpawelzik in https://github.com/aai-institute/lakefs-spec/pull/271
* Docs: Link to root-level modules in API docs by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/273
* fs.exists() should return True for common prefixes by ozkatz in https://github.com/aai-institute/lakefs-spec/pull/274

New Contributors
* leonpawelzik made their first contribution in https://github.com/aai-institute/lakefs-spec/pull/271
* ozkatz made their first contribution in https://github.com/aai-institute/lakefs-spec/pull/274

**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.7.1...v0.8.0

What's Changed
* Update Python dependencies, change ruff options by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/262
* Fix ls by renesat in https://github.com/aai-institute/lakefs-spec/pull/260
* Log a warning for uncommitted changes on transaction exit by maxmynter in https://github.com/aai-institute/lakefs-spec/pull/266
* Always show the project name in the header by janwillemkl in https://github.com/aai-institute/lakefs-spec/pull/263
* Docs: Fix code highlighting in third-party libraries integration guide by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/268

New Contributors
* renesat made their first contribution in https://github.com/aai-institute/lakefs-spec/pull/260

**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.7.0...v0.7.1