Prefect

See these [docs](https://docs.prefect.io/latest/guides/cli-shell) to learn how to:
- run a shell command as a Prefect flow on-demand with `watch`
- schedule a shell command as a recurring Prefect flow using `serve`

See the PR for implementation details: https://github.com/PrefectHQ/prefect/pull/11998

Other Enhancements 🌟
- Integrate composite triggers with the `DeploymentTrigger` YAML representation — https://github.com/PrefectHQ/prefect/pull/12413
- Add JSON Artifacts — https://github.com/PrefectHQ/prefect/pull/12295
- Add auto-provisioning option for Cloud Run V2 push work pools — https://github.com/PrefectHQ/prefect/pull/12422

... and numerous 🐛 fixes!

**Full Changelog:** https://github.com/PrefectHQ/prefect/compare/2.16.6...2.16.7

See [the release notes](https://github.com/PrefectHQ/prefect/blob/main/RELEASE-NOTES.md#release-2167) for more!

Enhancements to `prefect-dbt` for running `dbt-core` commands

Introducing `prefect-dbt` summary artifacts! With summary artifacts, you get a view of all of the runs that succeeded, failed, or were skipped as well as where the failed models live in your dbt project and why they failed. This exposes information about each dbt node in a succinct format that teams can use for development, debugging, insights, and so much more.

These changes are available in `prefect-dbt` version 0.5.0!

<img width="1184" alt="prefect-dbt-summary-artifact-example" src="https://github.com/PrefectHQ/prefect/assets/104510333/3868b961-5aff-4115-b409-f86d3992704d">

See the following pull requests for implementation details:
- https://github.com/PrefectHQ/prefect/pull/12964
- https://github.com/PrefectHQ/prefect/pull/13387
- https://github.com/PrefectHQ/prefect/pull/13406

Enhancements

- Enable flow run infra overrides section in the Prefect UI - https://github.com/PrefectHQ/prefect-ui-library/pull/2417

Experimental
Events and Automations

- Add ability to create and manage automations in the Prefect UI - https://github.com/PrefectHQ/prefect/pull/13342

Documentation

- Update documentation formatting for `prefect-ray` - https://github.com/PrefectHQ/prefect/pull/13385

Integrations

- Update all integrations libraries to pin `prefect<3.0.0` - https://github.com/PrefectHQ/prefect/pull/13408

Integration library releases

This release was accompanied by the following integration library releases:

- `prefect-aws` - 0.4.17
- `prefect-azure` - 0.3.10
- `prefect-bitbucket` - 0.2.5
- `prefect-dask` - 0.2.9
- `prefect-databricks` - 0.2.7
- `prefect-dbt` - 0.5.0
- `prefect-docker` - 0.5.2
- `prefect-email` - 0.3.5
- `prefect-gcp` - 0.5.12
- `prefect-github` - 0.2.5
- `prefect-gitlab` - 0.2.5
- `prefect-kubernetes` - 0.3.10
- `prefect-ray` - 0.3.6
- `prefect-shell` - 0.2.5
- `prefect-slack` - 0.2.6
- `prefect-snowflake` - 0.27.6
- `prefect-sqlalchemy` - 0.4.3

**All changes**: https://github.com/PrefectHQ/prefect/compare/2.19.0...2.19.1

✨ This release includes a number of enhancements and fixes!


Support for major infrastructure and distributed task integrations
As `prefect-dask` and other integrations have been added to the prefect codebase, this release adds these integrations as extra requirements of the prefect package, making it easier to install support for everything in your Prefect stack:

bash
pip install 'prefect[dask]'


We loved this community contribution so much, we did it for all our first-party integrations:

bash
pip install 'prefect[aws,kubernetes,dask,dbt,sqlalchemy,slack]'


You can see the full list of Prefect's extra requirements in [our setup.py](https://github.com/PrefectHQ/prefect/blob/main/setup.py#L43).

Support for timeout seconds in global concurrency context manager
You may want to fail immediately if a global concurrency slot is unavailable. Rather than block and wait, you can now specify a `timeout_seconds` argument in the global concurrency context manager and catch a `TimeoutError` if a slot is not available within the specified time.

python
flow
def fail_immediately_flow():
try:
with concurrency("there-can-be-only-one", occupy=1, timeout_seconds=0.1):
do_something_resource_intensive()
except TimeoutError:
return Cancelled(message="Another flow run is already running")


Manage global concurrency limits via the CLI
Global concurrency limits let you control how many operations can run simultaneously-- now you can create, read, edit, and delete global concurrency limits via the Prefect CLI!

To create a new concurrency limit, use the `prefect gcl create` command. You must specify a `--limit` argument, and can optionally specify a `--slot-decay-per-second` and `--disable` argument.

bash

Experimental
Engine
- Wire up new engine to deployment runs — https://github.com/PrefectHQ/prefect/pull/12914

Fixes
- Fix parameters becoming unresponsive and disappearing in Prefect UI — https://github.com/PrefectHQ/prefect-ui-library/pull/2355

**All changes**: https://github.com/PrefectHQ/prefect/compare/2.18.2...2.18.3