Prefect

Released on Apr 21, 2020.

Features

- None

Enhancements

- Allow GraphQL endpoint configuration via `config.toml` for remote deployments of the UI - [2338](https://github.com/PrefectHQ/prefect/pull/2338)
- Add option to connect containers created by Docker agent to an existing Docker network - [2334](https://github.com/PrefectHQ/prefect/pull/2334)
- Expose `datefmt` as a configurable logging option in Prefect configuration - [2340](https://github.com/PrefectHQ/prefect/pull/2340)
- The Docker agent configures containers to auto-remove on completion - [2347](https://github.com/PrefectHQ/prefect/pull/2347)
- Use YAML's safe load and dump commands for the `server start` CLI command - [2352](https://github.com/PrefectHQ/prefect/pull/2352)
- New `RemoteDaskEnvironment` specifically for running Flows on an existing Dask cluster - [2367](https://github.com/PrefectHQ/prefect/pull/2367)

Task Library

- None

Fixes

- Fix `auth create-token` CLI command specifying deprecated `role` instead of `scope` - [2336](https://github.com/PrefectHQ/prefect/issues/2336)
- Fix local schedules not continuing to schedule on errors outside of runner's control - [2133](https://github.com/PrefectHQ/prefect/issues/2133)
- Fix `get_latest_cached_states` pulling incorrect upstream cached states when using Core server as the backend - [2343](https://github.com/PrefectHQ/prefect/issues/2343)

Deprecations

- None

Breaking Changes

- None

Contributors

- [Brad McElroy](https://github.com/limx0)
- [Joe Schmid](https://github.com/joeschmid)

Released on Apr 14, 2020.

Features

- None

Enhancements

- Task logical operators (e.g. `And`, `Or`, ...) no longer implicitly cast to `bool` - [2303](https://github.com/PrefectHQ/prefect/pull/2303)
- Allow for dynamically changing secret names at runtime - [2302](https://github.com/PrefectHQ/prefect/pull/2302)
- Update `ifelse` and `switch` to return tasks representing the output of the run branch - [2310](https://github.com/PrefectHQ/prefect/pull/2310)

Task Library

- Rename the base secret tasks for clarity - [2302](https://github.com/PrefectHQ/prefect/pull/2302)

Fixes

- Fix possible subprocess deadlocks when sending stdout to `subprocess.PIPE` - [2293](https://github.com/PrefectHQ/prefect/pull/2293), [#2295](https://github.com/PrefectHQ/prefect/pull/2295)
- Fix issue with Flow registration to non-standard Cloud backends - [2292](https://github.com/PrefectHQ/prefect/pull/2292)
- Fix issue with registering Flows with Server that have required scheduled Parameters - [2296](https://github.com/PrefectHQ/prefect/issues/2296)
- Fix interpolation of config for dev services CLI for Apollo - [2299](https://github.com/PrefectHQ/prefect/pull/2299)
- Fix pytest Cloud and Core server backend fixtures - [2319](https://github.com/PrefectHQ/prefect/issues/2319)
- Fix `AzureResultHandler` choosing an empty Secret over provided connection string - [2316](https://github.com/PrefectHQ/prefect/issues/2316)
- Fix containers created by Docker agent on Linux not being able to reach out to host API - [2324](https://github.com/PrefectHQ/prefect/issues/2324)

Deprecations

- None

Breaking Changes

- Remove `env_var` initialization from `EnvVarSecret` in favor of `name` - [2302](https://github.com/PrefectHQ/prefect/pull/2302)

Contributors

- [Brad McElroy](https://github.com/limx0)

Released on Apr 7, 2020.

Features

- CI build for prefect server images - [2229](https://github.com/PrefectHQ/prefect/pull/2229), [#2275](https://github.com/PrefectHQ/prefect/issues/2275)
- Allow kwargs to boto3 in S3ResultHandler - [2240](https://github.com/PrefectHQ/prefect/issues/2240)

Enhancements

- Add flags to `prefect server start` for disabling service port mapping - [2228](https://github.com/PrefectHQ/prefect/pull/2228)
- Add options to `prefect server start` for mapping to host ports - [2228](https://github.com/PrefectHQ/prefect/pull/2228)
- Return `flow_run_id` from CLI `run` methods for programmatic use - [2242](https://github.com/PrefectHQ/prefect/pull/2242)
- Add JSON output option to `describe` CLI commands - [1813](https://github.com/PrefectHQ/prefect/issues/1813)
- Add ConstantResult for eventually replacing ConstantResultHandler - [2145](https://github.com/PrefectHQ/prefect/issues/2145)
- Add new `diagnostics` mode for timing requests made to Cloud - [2283](https://github.com/PrefectHQ/prefect/pull/2283)

Task Library

- Make `project_name` optional for `FlowRunTask` to allow for use with Prefect Core's server - [2266](https://github.com/PrefectHQ/prefect/pull/2266)
- Adds `prefect.tasks.docker.container.RemoveContainer`

Fixes

- Fix `S3ResultHandler` safe retrieval of `_client` attribute - [2232](https://github.com/PrefectHQ/prefect/issues/2232)
- Change default log `timestamp` value in database to be identical to other tables instead of a hard coded value - [2230](https://github.com/PrefectHQ/prefect/pull/2230)

Deprecations

- None

Breaking Changes

- None

Contributors

- [Manuel Aristarán](https://github.com/jazzido)
- [szelenka](https://github.com/szelenka)
- [Aditya Bhumbla](https://github.com/abhumbla)
- [Alex Cano](https://github.com/alexisprince1994)

Released on Mar 29, 2020.

Features

- Open source database backend, GraphQL API and UI - [2218](https://github.com/PrefectHQ/prefect/pull/2218)
- Add `prefect server start` CLI command for spinning up database and UI - [2214](https://github.com/PrefectHQ/prefect/pull/2214)

Enhancements

- Add ValidationFailed state and signal in anticipation of validating task outputs - [2143](https://github.com/PrefectHQ/prefect/issues/2143)
- Add max polling option to all agents - [2037](https://github.com/PrefectHQ/prefect/issues/2037)
- Add GCSResult type [2141](https://github.com/PrefectHQ/prefect/issues/2141)
- Add Result.validate method that runs validator functions initialized on Result [2144](https://github.com/PrefectHQ/prefect/issues/2144)
- Convert all GraphQL calls to have consistent casing - [2185](https://github.com/PrefectHQ/prefect/pull/2185) [#2198](https://github.com/PrefectHQ/prefect/pull/2198)
- Add `prefect backend` CLI command for switching between Prefect Core server and Prefect Cloud - [2203](https://github.com/PrefectHQ/prefect/pull/2203)
- Add `prefect run server` CLI command for starting flow runs without use of project name - [2203](https://github.com/PrefectHQ/prefect/pull/2203)
- Make `project_name` optional during flow registration to support Prefect Core's server - [2203](https://github.com/PrefectHQ/prefect/pull/2203)
- Send flow run and task run heartbeat at beginning of run time - [2203](https://github.com/PrefectHQ/prefect/pull/2203)

Task Library

- None

Fixes

- Fix issue with heartbeat failing if any Cloud config var is not present - [2190](https://github.com/PrefectHQ/prefect/issues/2190)
- Fix issue where `run cloud` CLI command would pull final state before last batch of logs - [2192](https://github.com/PrefectHQ/prefect/pull/2192)
- Fix issue where the `S3ResultHandler` would attempt to access uninitialized attribute - [2204](https://github.com/PrefectHQ/prefect/issues/2204)

Deprecations

- None

Breaking Changes

- Drop support for Python 3.5 - [2191](https://github.com/PrefectHQ/prefect/pull/2191)
- Remove `Client.write_run_log` - [2184](https://github.com/PrefectHQ/prefect/issues/2184)
- Remove `Client.deploy` and `flow.deploy` - [2183](https://github.com/PrefectHQ/prefect/issues/2183)

Contributors

- None

Released on Mar 18, 2020.

Features

- None

Enhancements

- Update Cloud config name for heartbeat settings - [2081](https://github.com/PrefectHQ/prefect/pull/2081)
- Add examples to Interactive API Docs - [2122](https://github.com/PrefectHQ/prefect/pull/2122)
- Allow users to skip Docker healthchecks - [2150](https://github.com/PrefectHQ/prefect/pull/2150)
- Add exists, read, and write interfaces to Result [2139](https://github.com/PrefectHQ/prefect/issues/2139)
- Add Cloud UI links to Slack Notifications - [2112](https://github.com/PrefectHQ/prefect/issues/2112)

Task Library

- None

Fixes

- Fix S3ResultHandler use of a new boto3 session per thread - [2108](https://github.com/PrefectHQ/prefect/issues/2108)
- Fix issue with stateful function reference deserialization logic mutating state - [2159](https://github.com/PrefectHQ/prefect/pull/2159)
- Fix issue with `DateClock` serializer - [2166](https://github.com/PrefectHQ/prefect/issues/2166)
- Fix issue with scheduling required parameters - [2166](https://github.com/PrefectHQ/prefect/issues/2166)

Deprecations

- Deprecate cache\_\* and result_handler options on Task and Flow objects [2140](https://github.com/PrefectHQ/prefect/issues/2140)

Breaking Changes

- None

Contributors

- [alexisprince1994](https://github.com/alexisprince1994)

Released on Mar 4, 2020.

Fixes

- Change `task.log_stdout` retrieval from task runner to `getattr` in order to preserve running flows of older `0.9.x` versions - [2120](https://github.com/PrefectHQ/prefect/pull/2120)