Kamu

Changed
- Build improvements
- Excluding most of `openssl` from the build
- Removed `--pull-test-images` flag from `kamu init` command in favor of pulling images directly during tests

Fixed
- Verification of data through reproducibility should ignore differences in data and checkpoint sizes

Fixed
- `kamu add` command no longer fails to deduplicate existing datasets
- Tracing spans in logs no longer interfere with one another in concurrent code
Changed
- Improved dataset creation logic to make it more resilient to various failures
- Improved `kamu add` command error handling

Fixed
- Preserving previous watermark upon fetch step returning no data

Changed
- Deprecated `.kamu/datasets/<dataset>/cache` directory - a workspace upgrade will be required (see below)
- Support ingest source state per [ODF RFC-009](https://github.com/open-data-fabric/open-data-fabric/blob/master/rfcs/009-ingest-source-state.md)
- Introduced workspace-wide cache in `.kamu/cache`
- Introduced workspace versioning and upgrade procedure via `kamu system upgrade-workspace` command
- Upgraded to latest `datafusion` and `arrow`
Added
- New `kamu system gc` command to run garbage collector (currently only cleans up cache)

Fixed
- Improved recovery after aborting smart protocol push/pull operations