Datacontract-cli

Added

- `datacontract test --output-format junit --output TEST-datacontract.xml` Export CLI test results
to a file, in a standard format (e.g. JUnit) to improve CI/CD experience (650)
- `dbt` & `dbt-sources` export formats now support the optional `--server` flag to adapt the DBT column `data_type` to specific SQL dialects

Changed

- Changed Docker base image to python:3.11-bullseye
- Relax fastparquet dependency

Fixed

- Unicode Encode Error when exporting data contract YAML to HTML
(652)
- Fix multiline descriptions in the DBT export functionality
- Incorrectly parsing $ref values in definitions (664)
- Better error message when the server configuration is missing in a data contract (670)
- Improved default values in ODCS generator to avoid breaking schema validation (671)
- Updated ODCS v3 generator to drop the "is" prefix from fields like `isNullable` and `isUnique` (669)
- Fix issue when testing databricks server with ODCS format

Added

- `datacontract test` now also executes tests for service levels freshness and retention (407)

Changed

- `datacontract import --format sql` is now using SqlGlot as importer.
- `datacontract import --format sql --dialect <dialect>` Dialect can now to defined when importing
SQL.

Fixed

- Schema type checks fail on nested fields for Databricks spark (618)
- Export to Avro add namespace on field as optional configuration (631)

Removed

- `datacontract test --examples`: This option was removed as it was not very popular and top-level
examples section is deprecated in the Data Contract Specification v1.1.0 (628)
- Support for `odcs_v2` (645)

Added

- `datacontract export --format custom`: Export to custom format with Jinja
- `datacontract api` now can be protected with an API key

Changed

- `datacontract serve` renamed to `datacontract api`

Fixed

- Fix Error: 'dict object' has no attribute 'model_extra' when trying to use type: string with enum
values inside an array (619)

Added

- datacontract serve: now has a route for testing data contracts
- datacontract serve: now has a OpenAPI documentation on root

Changed

- FastAPI endpoint is now moved to extra "web"

Fixed

- API Keys for Data Mesh Manager are now also applied for on-premise installations

Added

- datacontract import --format csv
- publish command also supports publishing ODCS format
- Option to separate physical table name for a model via config option (270)

Changed
- JSON Schemas are now bundled with the application (598)
- datacontract export --format html: The model title is now shown if it is different to the model
name (585)
- datacontract export --format html: Custom model attributes are now shown (585)
- datacontract export --format html: The composite primary key is now shown. (591)
- datacontract export --format html: now examples are rendered in the model and definition (497)
- datacontract export --format sql: Create arrays and struct for Databricks (467)

Fixed
- datacontract lint: Linter 'Field references existing field' too many values to unpack (expected
2) (586)
- datacontract test (Azure): Error querying delta tables from azure storage. (458)
- datacontract export --format data-caterer: Use `fields` instead of `schema`
- datacontract export --format data-caterer: Use `options` instead of `generator.options`
- datacontract export --format data-caterer: Capture array type length option and inner data type
- Fixed schemas/datacontract-1.1.0.init.yaml not included in build and `--template` not resolving file

Fixed
- Fixed an issue when resolving project's dependencies when all extras are installed.
- Definitions referenced by nested fields are not validated correctly (595)
- Replaced deprecated `primary` field with `primaryKey` in exporters, importers, examples, and Jinja templates for backward compatibility. Fixes [518](https://github.com/your-repo/your-project/issues/518).
- Cannot execute test on column of type record(bigquery) 597