Prefect

Released on March 10, 2021.

Enhancements

- Upgrade hasura to 1.3.3 in Prefect Server - [4126](https://github.com/PrefectHQ/prefect/pull/4126)
- Add `--docker-client-timeout` flag to docker agent, for configuring the timeout for all docker API requests - [4232](https://github.com/PrefectHQ/prefect/pull/4232)
- Make `--slug` flag optional in `prefect server create-tenant` - [4240](https://github.com/PrefectHQ/prefect/pull/4240)
- Move `command`, `environment`, `cpu`, `memory`, `execution_role_arn`, and `task_role_arn` configuration for ECS tasks from definition time to run time in the ECS agent - [4211](https://github.com/PrefectHQ/prefect/pull/4211)
- Register (and deregister) a new task definition for every flow run in ECS agent - [4211](https://github.com/PrefectHQ/prefect/pull/4211)

Task Library

- Adds new filesystem `Copy` and `Remove` tasks - [4202](https://github.com/PrefectHQ/prefect/pull/4202)

Fixes

- Don't forward `nout` to mapped tasks - [4206](https://github.com/PrefectHQ/prefect/pull/4206)
- Fix `Task` signature generation in the presence of with variadic kwargs - [4235](https://github.com/PrefectHQ/prefect/pull/4235)
- Ensure `Flow` is serializable using `pickle` - [4209](https://github.com/PrefectHQ/prefect/pull/4209)

Contributors

- [Ben Fogelson](https://github.com/benfogelson)
- [Marwan S.](https://github.com/marwan116)
- [Timo S.](https://github.com/sti0)

Released on March 3, 2021.

Features

- Add command `prefect server config` to output configured docker-compose yaml - [4176](https://github.com/PrefectHQ/prefect/pull/4176)

Enhancements

- Add `project_name` and `project_id` to context during Cloud/Server flow runs - [4083](https://github.com/PrefectHQ/prefect/pull/4083)
- Better error message when flow not found in file - [4182](https://github.com/PrefectHQ/prefect/pull/4182)
- Improve generated names for `GetItem` tasks - [4183](https://github.com/PrefectHQ/prefect/pull/4183)
- Add `base_url` option to `GitHub` storage - [4194](https://github.com/PrefectHQ/prefect/pull/4194)

Task Library

- Add filehandling tasks `Move`, `Unzip`, `Zip` - [4131](https://github.com/PrefectHQ/prefect/pull/4139)
- Add `msg_plain`, `email_to_cc`, and `email_to_bcc` options to `EmailTask` - [4157](https://github.com/PrefectHQ/prefect/pull/4157)
- Add `jar_params` option to `DatabricksRunNow` task - [4157](https://github.com/PrefectHQ/prefect/pull/4178)

Fixes

- Make task slug generation robust to modifying existing task names - [4189](https://github.com/PrefectHQ/prefect/pull/4189)
- Forward `client_options` to `S3Result` from `S3` storage - [4195](https://github.com/PrefectHQ/prefect/pull/4195)

Contributors

- [David Zucker](https://github.com/davzucky)
- [Jacob Hayes](https://github.com/JacobHayes)
- [Joël Luijmes](https://github.com/joelluijmes)
- [Timo S.](https://github.com/sti0)
- [Yogi Patel](https://github.com/ypatel-whitepages)

Released on February 23, 2021.

Fixes

- Dynamically import compression libraries for `CompressedSerializer` - [4150](https://github.com/PrefectHQ/prefect/pull/4150)
- Support passing environment variables containing `=` through agent CLI `--env` flag - [4160](https://github.com/PrefectHQ/prefect/pull/4160)

Released on February 16, 2021.

Enhancements

- Add `CompressedSerializer` class - [4063](https://github.com/PrefectHQ/prefect/pull/4063)
- Allow `Client` timeout seconds to be configurable through configuration - [4118](https://github.com/PrefectHQ/prefect/issues/4118)

Task Library

- Update `FilterTask` to allow logging the filtered output via a function - [4121](https://github.com/PrefectHQ/prefect/pull/4121)
- Add `FivetranSyncTask`, to manage your [Fivetran](https://fivetran.com) connector sync process - [#4116](https://github.com/PrefectHQ/prefect/pull/4116)

Fixes

- Reduce the number of boto3 clients created across Prefect when interacting with AWS services - [4115](https://github.com/PrefectHQ/prefect/pull/4115)

Deprecations

- Deprecate the `use_session` argument in all AWS-related components - [4115](https://github.com/PrefectHQ/prefect/pull/4115)

Contributors

- [Amanda Wee](https://github.com/amanda-wee)
- [Andrew Hannigan](https://github.com/AndrewHannigan)
- [Craig Wright](https://github.com/crw)
- [Nick Acosta](https://github.com/PubChimps)
- [Timo S.](https://github.com/sti0)

Released on February 11, 2021.

Enhancements

- Add option to provide version group ID to `prefect run flow` CLI command - [4100](https://github.com/PrefectHQ/prefect/pull/4100)

Fixes

- Fix bug in agent healthcheck route that was introduced in 0.14.7 - [4109](https://github.com/PrefectHQ/prefect/pull/4109)

Released on February 10, 2021.

Enhancements

- Support multiple docker networks with Docker Agent - [3986](https://github.com/PrefectHQ/prefect/issues/3986)
- Add healthchecks to prefect server - [4041](https://github.com/PrefectHQ/prefect/pull/4041)
- Raise custom `TimeoutError` for task timeouts to allow for more granular user control - [4091](https://github.com/PrefectHQ/prefect/issues/4091)
- Add `access_token_secret` to `GitHub`, `GitLab`, and `Bitbucket` storage, making the Prefect secret containing an access token to these services configurable - [4059](https://github.com/PrefectHQ/prefect/pull/4059)
- Add `--skip-if-flow-metadata-unchanged` to `prefect register flow` CLI command that avoids bumping flow version if flow metadata has not changed - [4061](https://github.com/PrefectHQ/prefect/pull/4061)
- Add `--skip-if-exists` to `prefect create project` CLI command that safely skips if the project has already been created - [4061](https://github.com/PrefectHQ/prefect/pull/4061)
- Add new `Module` storage class, for referencing flows importable from a Python module - [4073](https://github.com/PrefectHQ/prefect/pull/4073)
- Drop resource limits from manifest generated using `prefect agent kubernetes install` - [4077](https://github.com/PrefectHQ/prefect/pull/4077)

Task Library

- Add new tasks for communication with an Exasol database - [4044](https://github.com/PrefectHQ/prefect/pull/4044)

Fixes

- Fix task decorator chaining by using `inspect.unwrap` instead of `__wrap__` - [4053](https://github.com/PrefectHQ/prefect/pull/4053)
- Forward Prefect backend type to deployed flow runs, ensuring backend-specific logic functions properly - [4076](https://github.com/PrefectHQ/prefect/pull/4076)
- Patch around bug in dask's multiprocessing scheduler introduced in Dask 2021.02.0 - [4089](https://github.com/PrefectHQ/prefect/pull/4089)

Deprecations

- Docker agent `network` kwarg deprecated in favor of `networks` - [3986](https://github.com/PrefectHQ/prefect/issues/3986)

Breaking Changes

- Remove unused `Storage.get_env_runner` method - [4059](https://github.com/PrefectHQ/prefect/pull/4059)
- Remove private utilities in `prefect.utilities.git` - [4059](https://github.com/PrefectHQ/prefect/pull/4059)

Contributors

- [Alex P.](https://github.com/alexifm)
- [Marwan S.](https://github.com/marwan116)
- [Peter Roelants](https://github.com/peterroelants)
- [Timo S.](https://github.com/sti0)