Kamu

Changed
- Maintenance release - no user-facing changes.
- Migrated from explicit threading to `tokio` async.
- Better separation of architectural layers.
- Improved error handling.

Fixed
- Added more validation on events that appear in `DatasetSnapshot`s.
- Fix flag completion after `clap` crate upgrade.

Changed
- Implements [ODF RFC-004](https://github.com/open-data-fabric/open-data-fabric/blob/master/rfcs/004-metadata-extensibility.md).
- Workspaces will need to be re-created. This is the last major metadata format change - we will be working on stabilizing metadata now.
- Some manifest formats have changed and will need to be updated.
- `DatasetSnapshot` needs to specify `kind` field (`root` or `derivative`)
- `DatasetSnapshot.source` was replaced with `metadata` which is an array of metadata events

Changed
- Implements [ODF RFC-003](https://github.com/open-data-fabric/open-data-fabric/blob/master/rfcs/003-content-addressability.md).
- Workspaces will need to be re-created. Sorry again!
- Some manifest formats have changed and will need to be updated.
- `Manifest.apiVersion` renamed to `version`
- `DatasetSnapshot.id` renamed to `name`
- `DatasetSourceDerivative.inputs` should now specify `id` (optional) and `name` (required)
- `TemporalTable.id` renamed to `name`
- Datasets now have a globally unique identity.
- IDs can be viewed using `kamu log -w`
- Metadata format switched to a much faster and compact `flatbuffers`.
- You can still inspect it as YAML using `kamu log --output-format yaml`

Changed
- Implements [ODF RFC-002](https://github.com/open-data-fabric/open-data-fabric/blob/master/rfcs/002-logical-data-hashes.md).
- Engines are no longer responsible for data hashing - a stable hash algorithm is implemented in `kamu`
- Pending data part files and checkpoints will be stored in `cache` directory along with other ingest artifacts
Added
- A fully working implementation of data integrity checks
- `kamu verify` command now accepts `--integrity` flag to only check data hashes without replaying transformations

Changed
- Implements [ODF RFC-001](https://github.com/open-data-fabric/open-data-fabric/blob/master/rfcs/001-record-offsets.md) that adds record offset system column.