Lakefs-spec

This release adds example code showing how to access lakeFS repositories from the [Hugging Face 🤗 Datasets](https://huggingface.co/docs/datasets/index) library to the documentation.

What's Changed
* Docs: Demonstrate integration of Hugging Face Datasets by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/275
* Bump linter dependencies by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/276


**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.8.0...v0.8.0.post0

This release changes the behavior of `LakeFSFileSystem.exists()` when encountering a `CommonPrefix`, which is lakeFS' directory abstraction. Afterwards, the file system can detect existing directories/common prefixes on a branch, returning `True` for any existing directories.

What's Changed
* Update outdated CI actions by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/269
* Update pre-commit hooks by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/270
* Fixed broken URL in README.md by leonpawelzik in https://github.com/aai-institute/lakefs-spec/pull/271
* Docs: Link to root-level modules in API docs by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/273
* fs.exists() should return True for common prefixes by ozkatz in https://github.com/aai-institute/lakefs-spec/pull/274

New Contributors
* leonpawelzik made their first contribution in https://github.com/aai-institute/lakefs-spec/pull/271
* ozkatz made their first contribution in https://github.com/aai-institute/lakefs-spec/pull/274

**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.7.1...v0.8.0

What's Changed
* Update Python dependencies, change ruff options by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/262
* Fix ls by renesat in https://github.com/aai-institute/lakefs-spec/pull/260
* Log a warning for uncommitted changes on transaction exit by maxmynter in https://github.com/aai-institute/lakefs-spec/pull/266
* Always show the project name in the header by janwillemkl in https://github.com/aai-institute/lakefs-spec/pull/263
* Docs: Fix code highlighting in third-party libraries integration guide by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/268

New Contributors
* renesat made their first contribution in https://github.com/aai-institute/lakefs-spec/pull/260

**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.7.0...v0.7.1

⭐ Highlights

Changes the lakeFS-spec transaction to operate on short-lived ephemeral branches (258).

Transaction versioning operations are implicitly scoped to the given repository and transaction branch, so you do not need to manually specify these arguments anymore:

python
will automatically merge into `main` upon successful completion of `tx`.
with fs.transaction("my-repo", "main") as tx:
fs.put("my-file.txt", f"my-repo/{tx.branch.id}/my-file.txt")
tx.commit(message="Add my file")


🚨 Breaking changes

The usage of `LakeFSFileSystem.transaction` was changed. It is now necessary to call it with a repository name to properly initialize the transaction.

What's Changed
* Bump lakeFS service container version to v1.7.0 by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/249
* Replace `fs._open()` with proper `fs.open()` implementation by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/250
* Add integration tests for third-party data science libraries by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/251
* (docs): Add lakeFS-spec and lakeFS-SDK transaction differences by maxmynter in https://github.com/aai-institute/lakefs-spec/pull/252
* Update project metadata by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/256
* Split lakefs-spec test job into multiple jobs by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/261
* Introduce new transaction model based on ephemeral branches by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/258


**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.6.1...v0.7.0

⭐ Highlights

This release marks the completion of the lakeFS SDK wrapper migration. All available functionality is now expressed in terms of abstractions from the new `lakefs` Python package.

As a particular consequence, the `LakeFSFile` was removed in favor of lakeFS' own file-like object APIs. For simple file interactions through the file system only (including transactions), this will not result in breaking changes.

What's Changed
* Slim down the bug report and feature request templates by janwillemkl in https://github.com/aai-institute/lakefs-spec/pull/235
* Update dev requirements, fix lakefs v0.2.0 regression by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/239
* Implement more APIs in terms of `lakefs` abstractions by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/240
* Fix `fs.rm()` for the recursive case by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/243
* Add test coverage for commits to repo information tests by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/244
* Remove Placeholder from interface typing, use new ReferenceType hint by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/245
* Add lakeFS package versions to pytest header by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/246
* Update bug-report.yaml by Maciej818 in https://github.com/aai-institute/lakefs-spec/pull/247
* Simplify revision parsing in the tutorial notebook by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/248


**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.6.0...v0.6.1

⭐ Highlights

- lakeFS-spec is now using the newly release [`lakefs` high-level Python SDK](https://lakefs.io/blog/improved-python-experience/) under the hood (see #231)
- the project now has a logo in all the relevant places 🎨

🚨 Breaking Changes

- Loading `lakectl.yaml` configuration from non-default paths is no longer supported (in line with the `lakefs` Python SDK)

What's Changed
* Correctly set docs version number for release workflow by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/228
* Docs: Update project highlights by janwillemkl in https://github.com/aai-institute/lakefs-spec/pull/229
* Several small test improvements by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/230
* Migrate the package to use the new `lakefs` SDK wrapper library by nicholasjng in https://github.com/aai-institute/lakefs-spec/pull/231
* Implement deletes using the lakeFS branch API by maxmynter in https://github.com/aai-institute/lakefs-spec/pull/236
* Add custom lakeFS-spec logo/favicon by AdrianoKF in https://github.com/aai-institute/lakefs-spec/pull/238

New Contributors
* janwillemkl made their first contribution in https://github.com/aai-institute/lakefs-spec/pull/229

**Full Changelog**: https://github.com/aai-institute/lakefs-spec/compare/v0.5.0...v0.6.0