Octue

Summary
After completion of an analysis, delete any files downloaded over its duration so the storage available to services isn't used up unnecessarily. This update frees service authors from having to deal with this themselves.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([562](https://github.com/octue/octue-sdk-python/pull/562))

Fixes
- After completion of an analysis, delete any files downloaded over its duration

Testing
- Avoid test logging issue
- Move runner tests into correct test class

<!--- END AUTOGENERATED NOTES --->

Summary
Make a number of improvements and fixes to message handling when using pull subscriptions. Also update the small amount of testing that interacts with GCP to use a dedicated separate GCP project.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([558](https://github.com/octue/octue-sdk-python/pull/558))

Enhancements
- Increase number of questions that can be asked concurrently in `Child.ask_multiple` to 32
- Make delivery acknowledgement and maximum hearbeat interval kwargs available in `Child.ask`
- Allow parents to start handling child responses from the first non-missed message (`n + 1`) if the first `n` were missed
- Add question UUID to heartbeat log messages
- Improve `PushSubscriptionCannotBePulled` error message

Fixes
- Mark question as delivered on receipt of first response from child in case the delivery acknowledgement message is missed
- Stop loss of delivered question UUIDs if local metadata file does not yet exist
- Avoid message gap greater than the delivery acknowledgement timeout causing failure to receive child messages
- Allow a start time of zero in message handler

Dependencies
- Update to latest versions of `protobuf` and `werkzeug` to avoid security issues

Operations
- Add terraform configuration for new test project

Refactoring
- Simplify nested conditional
- Minimise code within try/except block in `OrderedMessageHandler`
- Move message recording into `OrderedMessageHandler._handle_message`
- Factor out raising message handling error in message handler
- Rename `OrderedMessageHandler.received_messages` to `handled_messages`

Testing
- Use new URI for Strands JSON schemas in tests
- Use dedicated GCP project for testing services
<!--- END AUTOGENERATED NOTES --->

Summary
Improve the Cloud Run and Dataflow deployment dockerfiles and enable `poetry`-based packages on Dataflow.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([554](https://github.com/octue/octue-sdk-python/pull/554))

Enhancements
- Use `windpioneers/gdal-python` as base in Cloud Run default deployment `Dockerfile`
- Use latest `apache-beam` base for Dataflow default deployment dockerfile
- In both the Cloud Run and Dataflow default deployment dockerfiles:
- Improve dependency caching
- Remove unnecessary installation of `curl`
- Only install from one type of dependency file while building
- Use `/workspace` as `WORKDIR` in Dockerfile
- Use `/root/.poetry` for `POETRY_HOME`

Fixes
- Always install `poetry` in deployment dockerfiles

Operations
- Use latest `octue/check-semantic-version` GitHub action
<!--- END AUTOGENERATED NOTES --->

Summary
Enable automated code security scanning via GitHub's CodeQL.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([553](https://github.com/octue/octue-sdk-python/pull/553))

Operations
- Add `codeql.yml` workflow to enable code scanning

<!--- END AUTOGENERATED NOTES --->

Summary
Add a lock to avoid a race condition on message numbering when a child sets up a periodic monitor message thread to communicate with a parent. Detached serving of services in python has also been added.

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([552](https://github.com/octue/octue-sdk-python/pull/552))

New features
- Add ability to detach from locally serving services in `Service.serve`

Enhancements
- Allow multiple periodic monitor messages to be set up in an analysis
- Log when recording question UUID to delivered set in Cloud Run
- Log when the periodic monitor message threads are stopped
- Log that messages have been sent only after the send has been carried out successfully

Fixes
- Add threading lock for sending Pub/Sub messages and accessing/mutating the message number

<!--- END AUTOGENERATED NOTES --->

<!--- SKIP AUTOGENERATED NOTES --->
Contents ([551](https://github.com/octue/octue-sdk-python/pull/551))

Documentation
- Move `app.py` documentation to new page and update it with monitor message and analysis finalisation information

Dependencies
- Update lock file

<!--- END AUTOGENERATED NOTES --->