Twined

Contents

New Features
- [x] Add file tags template to twine schema
- [x] Add file tags template validation for datasets

Breaking changes
- [x] Require datasets to be inside "datasets" field in "manifest" fields of `twine.json`
- [x] Make tags an object and add labels field to manifest schema
- [x] Separate old tags in examples and tests into labels and new tags

Minor improvements
- [x] Update tags format in examples in docs
- [x] Remove `filters` field from manifest in `twine` schema
- [x] Remove `kind` field from `manifest` schema (i.e. "multi-dataset")
- [x] Factor out manifest schema into definition in `twine` schema and use for all three manifest types
- [x] Split getting schema from validating against schema in `Twine`

Fixes
- [x] Add missing `configuration_manifest` to twine schema
- [x] Fix name of `configuration_values_schema` in `twine` schema and `twine.json` files

Testing
- [x] Use correct method in manifest validation test
- [x] Update tags format

Contents

Fixes
- [x] Allow usage with python>=3.6

Contents

Breaking changes
- [x] Change tags serialisation to a sorted list of strings

Operations
- [x] Improve description of release workflow

Contents

Breaking changes
- [x] Disallow default values for credentials
- [x] Disallow extra fields in `credentials` strand of `twine.json`
- [x] Return set of names of validated credentials from `Twine.validate_credentials` (not their values)

Fixes
- [x] Add `*args` and `**kwargs` to `Twine.validate_credentials` to ignore extra arguments from `Twine.validate` (this was causing errors)
- [x] Fix skip CI tests flag

Minor improvements
- [x] Use latest versions of `flake8`, `isort`, and `black` in pre-commit and apply to all files retrospectively

Testing
- [x] Stop CI testing for python <= 3.7
- [x] Start CI testing on Windows and MacOS (and continue with Ubuntu)

Operations
- [x] Add automatic release workflow

Contents

Features
- [x] Allow skipping of CI tests if `skip_ci_tests` is in the commit body - the use case is to reduce unnecessary computation when knowing the tests will fail for a commit but still wanting to commit.

Breaking changes

- [x] Require environment variable for children credentials (67) - note this was accidentally merged into `main` just before this release branch rather than into this release branch

Minor fixes and improvements

- [x] Close 65 - ensure version consistency GitHub check doesn't fail on main (or any one-word) branch

Quality Checklist

- [x] New features are fully tested (No matter how much Coverage Karma you have)

Contents

New features
- [x] Replace `uri_env_name` field with new `backend` field in children schema that provides children using Google Pub/Sub with the configurations to communicate

Minor improvements and fixes
- [x] Add version consistency GitHub action
- [x] Fix child validation by adding missing argument `source`
- [x] Fix missing strand data validation by making strand attributes public (this removes the disparity between the attributes being private but the related names being used not including a leading underscore)