Prefect

Changes

Enhancements

- Add `get_latest` to `TaskRunView` — [6749](https://github.com/PrefectHQ/prefect/pull/6749)
- Update agents to allow logs to be disabled with `PREFECT__CLOUD__SEND_FLOW_RUN_LOGS` — [6833](https://github.com/PrefectHQ/prefect/pull/6833)

Fixes

- Fix bug where `scheduler_comm.close_rpc()` was not awaited in `DaskExecutor` — [6793](https://github.com/PrefectHQ/prefect/pull/6793)
- Fix bug where the Prefect diagnostics logger could duplicate output — [6832](https://github.com/PrefectHQ/prefect/pull/6832)

Task library

- Add validation for node type id and instance pool id in Databricks `NewCluster` — [6853](https://github.com/PrefectHQ/prefect/pull/6853)

Changes

Fixes

- Fix bug where flows with emoji characters pass `flow.validate()`, but fail to extract from file - [6375](https://github.com/PrefectHQ/prefect/pull/6375)
- Fix `FlowRunView` task run query errors when all task runs in the flwo run are cached - [6572](https://github.com/PrefectHQ/prefect/pull/6572)
- Update `FlowRunView` to avoid retrieval of cached static tasks during `latest` calls - [6572](https://github.com/PrefectHQ/prefect/pull/6572)
- Update `FlowRunView` to be robust to multithreaded usage - [6572](https://github.com/PrefectHQ/prefect/pull/6572)

Task Library

- Add state handler to log to Snowflake - [5671](https://github.com/PrefectHQ/prefect/pull/5671)
- Fix default idempotency token for `DatabricksSubmitMultitaskRun` - [6412](https://github.com/PrefectHQ/prefect/pull/6412)
- Fix custom tag type for Databricks `NewCluster` - [6573](https://github.com/PrefectHQ/prefect/pull/6009)
- Fix empty file handling in `S3List` task - [6028](https://github.com/PrefectHQ/prefect/pull/6028)

Contributors

- [Dennis Hinnenkamp](https://github.com/mcfuhrt)
- [Edmondo Porcu](https://github.com/edmondo1984)
- [Mate Hricz](https://github.com/matt9993)
- [Stéphan Taljaard](https://github.com/taljaards)

Enhancements

- Allow custom job name for Kubernetes flow runsto be set in job template - [5819](https://github.com/PrefectHQ/prefect/pull/5819)

Task Library

- Adds container parameter to `ReadNamespacedPodLogs` - [5979](https://github.com/PrefectHQ/prefect/pull/5979)
- Add `PowershellTask` for running commands with Microsoft Powershell - [6035](https://github.com/PrefectHQ/prefect/pull/6035)
- Move `azure-mgmt-datafactory` requirement to 'extras', instead of 'orchestration_extras' - [6018](https://github.com/PrefectHQ/prefect/pull/6018)
- Fix default initialization of `polling_interval` in `azure.datafactory.PipelineRun` - [6021](https://github.com/PrefectHQ/prefect/pull/6021)

Contributors

- [Alvaro Duran Tovar](https://github.com/hermesdt)
- [Chinmay Bhat](https://github.com/chinmay-bhat)

Changelog
Fixes

- Fix bug where `S3Result` could fail to deserialize if pickled with mismatched Prefect versions - [5978](https://github.com/PrefectHQ/prefect/pull/5978)
Task library

- Fix sftp-task imports - [5971](https://github.com/PrefectHQ/prefect/issues/5971)
- Fix definition of Databricks `GitSource` at task initialization - [5974](https://github.com/PrefectHQ/prefect/issues/5974)
- Add container parameter to `ReadNamespacedPodLogs` - [5979](https://github.com/PrefectHQ/prefect/pull/5979)
Contributors

- [Bral Bral](https://github.com/bralbral)
- [Edmondo Porcu](https://github.com/edmondo1984)
- [Alvaro Duran Tovar](https://github.com/hermesdt)

Changelog

Enhancements

- Add support for `ExtraArgs` on S3 result upload - [5887](https://github.com/PrefectHQ/prefect/pull/5887)
- Add configuration options for the client's rate limit backoff - [5823](https://github.com/PrefectHQ/prefect/pull/5823)

Fixes

- Allow untracked flows to be run during a tracked flow run - [5782](https://github.com/PrefectHQ/prefect/pull/5782)
- Fix bug with infinite loop when parsing DST cron schedules - [5957](https://github.com/PrefectHQ/prefect/pull/5957)
- Fix issue where complex Python dependencies could break Docker storage builds - [5860](https://github.com/PrefectHQ/prefect/issues/5860)
- Fix issue where `Git` storage could not be serialized without a `repo` - [5877](https://github.com/PrefectHQ/prefect/pull/5877)
- Fix issues with grpcio builds on the Prefect base image with Python 3.10 - [5832](https://github.com/PrefectHQ/prefect/pull/5832)

Task library

- Instantiate task kwargs during `DbtCloudRunTask.__init__` - [5831](https://github.com/PrefectHQ/prefect/pull/5831)
- Add `boto_kwargs` support to `S3List` - [5907](https://github.com/PrefectHQ/prefect/pull/5907)
- Fix `DatabricksSubmitMultitaskRun` inputs such as `access_control_list` - [5836](https://github.com/PrefectHQ/prefect/pull/5836)
- Add `single_user_name` to Databricks `NewCluster` - [5903](https://github.com/PrefectHQ/prefect/pull/5903)
- Allow extra arguments to Databricks `NewCluster` - [5949](https://github.com/PrefectHQ/prefect/pull/5949)
- Add `git_source` argument to `DatabricksSubmitMultitaskRun` - [5958](https://github.com/PrefectHQ/prefect/pull/5958)
- Add tasks for the Toloka API - [5865](https://github.com/PrefectHQ/prefect/pull/5865)
- Add tasks for Azure datafactory - [5921](https://github.com/PrefectHQ/prefect/pull/5921)
- Update the `DbtShellTask` return type to match `ShellTask` - [5872](https://github.com/PrefectHQ/prefect/pull/5872)
- Fix handling for Airbyte schedule keys - [5878](https://github.com/PrefectHQ/prefect/pull/5878)

Contributors

- [Bryan "Beege" Berry](https://github.com/TheBeege)
- [Cat Zhang](https://github.com/juscat)
- [EmilRex](https://github.com/EmilRex)
- [Max Firman](https://github.com/maxfirman)
- [Nate Nowack](https://github.com/zzstoatzz)
- [Nico Neumann](https://github.com/neumann-nico)
- [Robert Phamle](https://github.com/rphamle)
- [Vladislav Moiseev](https://github.com/vlad-mois)
- [edmondo1984](https://github.com/edmondo1984)