Octue

Summary
Allow services to use and be addressed by arbitrary string IDs (instead of just UUIDs). Services will now, by default, use the name and organisation in the service configuration by default e.g. `octue/test-service`.

**Backwards compatibility**
Upgrading to this release will not rename your services automatically unless you weren't already providing a static service ID via the `--service-id` option to the `octue start` command. To use the new service naming system, stop providing this option to the CLI and remove the `SERVICE_ID` environment variable from any deployed services.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([459](https://github.com/octue/octue-sdk-python/pull/459))

New features
- Use the `organisation` and `name` keys from the `octue.yaml` file as the default service ID e.g. `organisation/name`

Enhancements
- Add `organisation` key to `octue.yaml` file
- Add `service_id` attribute to `ServiceConfiguration`
- Allow the new default service ID to be overridden in the CLI and in the cloud
- Use ID from service configuration as `Child` internal service name
- Add a `__repr__` method to `Child`
- Update child services template to used named services

<!--- END AUTOGENERATED NOTES --->

Summary
Standardise the data resource class parameter orders and method names to provide a more consistent and intuitive interface. Also rename the `octue-app` CLI to `octue`.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([455](https://github.com/octue/octue-sdk-python/pull/455))
**IMPORTANT:** There are 5 breaking changes.

Enhancements
- 💥 **BREAKING CHANGE:** Standardise the parameter order in `Datafile`, `Dataset`, and `Manifest`. The order is now:
- `path` first
- Any other parameters that appear explicitly in the class next
- Any mixin kwargs after that

**How to migrate**
If you're using kwargs to provide parameters to instantiate the above classes, no change is needed. If you're using positional args, you'll need to reorder them or switch to using kwargs:
- `Manifest`: provide the `datasets` argument first
- `Dataset`: provide the arguments in this order, omitting any you're not already using:

path, files, recursive, hypothetical, id, name, tags, labels

- `Datafile`: Provide the `id`, `tags`, and `labels` arguments in this order after all other arguments, omitting any you're not already using
- Raise error if `files` parameter is invalid in `Dataset`

Refactoring
- 💥 **BREAKING CHANGE:** Rename `Dataset.download_all_files` to `Dataset.download`
- 💥 **BREAKING CHANGE:** Rename `Dataset.to_cloud` to `Dataset.upload`
- 💥 **BREAKING CHANGE:** Rename `Datafile.to_cloud` to `Datafile.upload`
- 💥 **BREAKING CHANGE:** Rename the CLI entrypoint from `octue-app` to `octue`

Fixes
- Add newline to end of `.octue` JSON files

Operations
- Use latest commit message checker in pre-commit checks

Dependencies
- Update dataflow `setup.py` file with correct twined version

Testing
- Remove redundant `project_name` parameter from datafiles

<!--- END AUTOGENERATED NOTES --->

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([454](https://github.com/octue/octue-sdk-python/pull/454))

Dependencies
- Use `twined=^0.5.0`, which removes deprecated support for datasets provided as lists instead of as dictionaries

<!--- END AUTOGENERATED NOTES --->

<!--- SKIP AUTOGENERATED NOTES --->
Summary
Remove deprecated code that's built up over the past few months.

Contents ([450](https://github.com/octue/octue-sdk-python/pull/450))
**IMPORTANT: There are 5 breaking changes.**

Refactoring
- **BREAKING CHANGE:** Remove deprecated cloud bucket name and path parameters

> Cloud paths must now be provided as `gs://bucket-name/path/within/bucket` instead of via the `bucket_name` and `path_within_bucket` parameters

- **BREAKING CHANGE:** Remove deprecated provision of datasets as a list to `Manifest`

> Datasets must now be provided as a dictionary mapping their name to their path or `Dataset` instance.

- **BREAKING CHANGE:** Remove deprecation warning if using `store_datasets` parameter
> Upload datasets using `Dataset.to_cloud` after running `Manifest.to_cloud` if you wish to upload the datasets within a manifest

- **BREAKING CHANGE:** Remove deprecated `update_cloud_metadata` parameter
> This has been renamed to `update_metadata`

- **BREAKING CHANGE:** Remove `Dataset.from_cloud` and `Dataset.from_local_directory`
> Just use the `Dataset` constructor e.g. `Dataset(path="gs://bucket-name/dataset")` or
`Dataset(path="local/dataset")` instead

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([449](https://github.com/octue/octue-sdk-python/pull/449))

Enhancements
- Allow `Dataset.to_cloud` to infer cloud location

Fixes
- Use cloud paths for relative paths when possible in `Dataset.to_cloud`

Refactoring
- Factor out cloud properties and methods common to `Dataset` and `Datafile` into new `CloudPathable` mixin

<!--- END AUTOGENERATED NOTES --->

Summary
Stop Cloud Run services from running a given question more than once and rely on Pub/Sub retries for connection problems.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([446](https://github.com/octue/octue-sdk-python/pull/446))

Enhancements
- Increase default delivery acknowledgement deadline to 120s

Fixes
- Acknowledge and drop questions redelivered to Cloud Run services based on their UUIDs
- Remove redundant question retries in `Service` and raise error instead if the delivery acknowledgement deadline is reached

Refactoring
- Factor out saving/updating of local metadata files
- Rename local metadata save function
- Rename `Service.send_exception_to_asker` to `Service.send_exception`
- Use "answer" instead of "response" terminology in `Service`

<!--- END AUTOGENERATED NOTES --->