Octue

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([419](https://github.com/octue/octue-sdk-python/pull/419))

New features
- Support push subscriptions for Google Pub/Sub services, allowing answers to be pushed to an HTTP endpoint

Enhancements
- Add `push_endpoint` parameter to `Subscription` constructor
- Add `is_pull_subscription` and `is_push_subscription` properties to `Subscription`

Testing
- Switch to parent/child language in `Service` tests for greater clarity/consistency

<!--- END AUTOGENERATED NOTES --->

Summary
Simplify manifest and dataset serialisation so their datasets' and files' metadata is gathered dynamically at instantiation instead of from hard-coded values in the serialisation. To allow this properly on both cloud and local platforms, the ability to store metadata locally has been introduced. This has also required the definition of a dataset to be tightened so that each dataset is either cloud-based or local, but not both.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([402](https://github.com/octue/octue-sdk-python/pull/402))
**IMPORTANT:** There are 5 breaking changes.

New features
- Store local datafile metadata locally in a `.octue` JSON file in the same directory

Enhancements

Dataset:
- **BREAKING CHANGE:** Change `Dataset` serialisation to only include the paths to its files and its own metadata
- **BREAKING CHANGE:** Store local dataset metadata locally in a `.octue` JSON file in its root directory instead of `datafile_metadata.json`
- Allow datasets to be instantiated from iterables of paths to files
- Remove `Pathable` mixin
- Unify `Dataset.path` and `Dataset.cloud_path`
- Raise error if trying to download files from a local dataset
- **BREAKING CHANGE:** Remove confusing way of adding files to datasets
- **BREAKING CHANGE:** Only allow one file to be added to a dataset at a time in `Dataset.add`
- Allow specification of path within dataset when adding a file to a dataset

Manifest:
- **BREAKING CHANGE:** Change `Manifest` serialisation to only include the paths to its datasets and its own metadata
- Remove `Pathable` mixin
- Remove `path` attribute

Other:
- Use `Serialisable.to_primitive` as the basis for `Serialisable.serialise` to simplify and speed up conversion to primitives
- Use `Manifest.to_primitive` in `Analysis.finalise`
- Update remaining JSON metaschema references to use the latest metaschema

Fixes
- Stop setting any given kwarg as attributes in `Dataset` and `Manifest`
- Ignore `.octue` files when constructing datasets

Dependencies
- Change minimum python version supported from `3.7` to `3.7.1`
- Use `pandas=^1.3` to avoid `numpy` array size errors
- Use `twined=0.3.0`

Refactoring
- Reorder and rename methods in `Datafile`, `Dataset`, and `Manifest`
- Move dataset files tag checking from `twined` into `Runner._validate_dataset_file_tags`
- Move datafile instantiation in `Dataset` into separate method

<!--- END AUTOGENERATED NOTES --->

Summary
Switch to using `poetry` as a package manager instead of `pip`.

Among other things, this means dependencies are resolved once (at dependency addition time) instead of every time the package is installed, speeding up installations of `octue` in e.g. docker containers. This is done by recording the exact dependency versions `poetry` resolved in a `poetry.lock` file.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([396](https://github.com/octue/octue-sdk-python/pull/396))

Operations
- Add `pyproject.toml` and `poetry.lock`
- Remove `setup.py` and `requirements-dev.txt`
- Update `tox.ini` to work with Poetry
- Update CI workflows and associated config files to work with Poetry
- Update `Dockerfile` to use Poetry
- Remove irrelevant `[dataflow]` extra specified in the Dataflow `Dockerfile`
- Create new `setup.py` file mirroring `pyproject.toml` in the `octue.cloud.deployment.google.dataflow` subpackage to allow Dataflow to continue to work (this must be updated alongside `pyproject.toml`
- Update python classifiers to include 3.7 and 3.9

Dependencies
- Upgrade to `Flask==2.0.3`

<!--- END AUTOGENERATED NOTES --->

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([401](https://github.com/octue/octue-sdk-python/pull/401))

Dependencies
- Use `dateparser==1.1.1` in template to avoid `regex` package bug

Testing
- Re-enable temporarily skipped test
<!--- END AUTOGENERATED NOTES --->

Contents ([400](https://github.com/octue/octue-sdk-python/pull/400))
<!--- SKIP AUTOGENERATED NOTES --->

Fixes
- Avoid mutating dictionary inputs
<!--- END AUTOGENERATED NOTES --->

Summary
Unify the configuration format in `octue.yaml` files for use as service configuration and for use by the cloud deployers.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([397](https://github.com/octue/octue-sdk-python/pull/397))

Enhancements
- Unify deployer configuration with service configuration
- Warn user if there are unused kwargs in `ServiceConfiguration` or `AppConfiguration`

Operations
- Allow choice of branch in `build-docker-image` workflow

<!--- END AUTOGENERATED NOTES --->