Zenml

What's Changed
* Implement base component tests by schustmi in https://github.com/zenml-io/zenml/pull/211
* Add chapter names by alex-zenml in https://github.com/zenml-io/zenml/pull/212
* Fix docstring error by alex-zenml in https://github.com/zenml-io/zenml/pull/213
* Hamza/add caching example by htahir1 in https://github.com/zenml-io/zenml/pull/214
* Update readme by alex-zenml in https://github.com/zenml-io/zenml/pull/216
* Hamza/add small utils by htahir1 in https://github.com/zenml-io/zenml/pull/219
* Update docs by alex-zenml in https://github.com/zenml-io/zenml/pull/220
* Docs fixes by alex-zenml in https://github.com/zenml-io/zenml/pull/222
* Baris/eng 182 standard interfaces by bcdurak in https://github.com/zenml-io/zenml/pull/209
* Fix naming error by alex-zenml in https://github.com/zenml-io/zenml/pull/221
* Remove framework design by alex-zenml in https://github.com/zenml-io/zenml/pull/224
* Alexej/eng 234 zenml integration install by alexej-zenml in https://github.com/zenml-io/zenml/pull/223
* Fix deployment section order by alex-zenml in https://github.com/zenml-io/zenml/pull/225
* the readme of the example by bcdurak in https://github.com/zenml-io/zenml/pull/227
* Kubeflow integration by schustmi in https://github.com/zenml-io/zenml/pull/226

New Contributors
* alexej-zenml made their first contribution in https://github.com/zenml-io/zenml/pull/223

**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.5.4...0.5.5

0.5.4 adds a [lineage tracking](https://github.com/zenml-io/zenml/tree/main/examples/lineage) integration to visualize lineage of pipeline runs! It also includes numerous bug fixes and optimizations.

What's Changed
* Fix typos by alex-zenml in https://github.com/zenml-io/zenml/pull/192
* Fix Apache Beam bug by alex-zenml in https://github.com/zenml-io/zenml/pull/194
* Fix apache beam logging bug by alex-zenml in https://github.com/zenml-io/zenml/pull/195
* Add step context by schustmi in https://github.com/zenml-io/zenml/pull/196
* Init docstrings by alex-zenml in https://github.com/zenml-io/zenml/pull/197
* Hamza/small fixes by htahir1 in https://github.com/zenml-io/zenml/pull/199
* Fix writing to metadata store with airflow orchestrator by schustmi in https://github.com/zenml-io/zenml/pull/198
* Use pipeline parameter name as step name in post execution by schustmi in https://github.com/zenml-io/zenml/pull/200
* Add error message when step name is not in metadata store by schustmi in https://github.com/zenml-io/zenml/pull/201
* Add option to set repo location using an environment variable by schustmi in https://github.com/zenml-io/zenml/pull/202
* Run cloudbuild after pypi publish by schustmi in https://github.com/zenml-io/zenml/pull/203
* Refactor component generation by schustmi in https://github.com/zenml-io/zenml/pull/204
* Removed unnecessary panel dependency by htahir1 in https://github.com/zenml-io/zenml/pull/206
* Updated README to successively install requirements by AlexejPenner in https://github.com/zenml-io/zenml/pull/205
* Store active stack in local config by schustmi in https://github.com/zenml-io/zenml/pull/208
* Hamza/eng 125 lineage tracking vis by htahir1 in https://github.com/zenml-io/zenml/pull/207

New Contributors
* AlexejPenner made their first contribution in https://github.com/zenml-io/zenml/pull/205

**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.5.3...0.5.4

What's Changed
* Make tests run in a random order by alex-zenml in https://github.com/zenml-io/zenml/pull/160
* Connect steps using *args by schustmi in https://github.com/zenml-io/zenml/pull/162
* Move location of repobeats image by alex-zenml in https://github.com/zenml-io/zenml/pull/163
* Hamza/add sam by htahir1 in https://github.com/zenml-io/zenml/pull/165
* Pipeline initialization with *args by schustmi in https://github.com/zenml-io/zenml/pull/164
* Improve detection of third party modules during class resolving by schustmi in https://github.com/zenml-io/zenml/pull/167
* Merge path_utils into fileio & refactor what was left by alex-zenml in https://github.com/zenml-io/zenml/pull/168
* Update docker files by schustmi in https://github.com/zenml-io/zenml/pull/169
* Hamza/deploy api reference by htahir1 in https://github.com/zenml-io/zenml/pull/171
* API Reference by schustmi in https://github.com/zenml-io/zenml/pull/172
* Add colour back into our github actions by alex-zenml in https://github.com/zenml-io/zenml/pull/176
* Refactor tests not raising by alex-zenml in https://github.com/zenml-io/zenml/pull/177
* Improve step and pipeline interface by schustmi in https://github.com/zenml-io/zenml/pull/175
* Alex/eng 27 windows bug again by htahir1 in https://github.com/zenml-io/zenml/pull/178
* Automated todo tracking by schustmi in https://github.com/zenml-io/zenml/pull/173
* Fix mypy issues related to windows by schustmi in https://github.com/zenml-io/zenml/pull/179
* Include Github URL to TODO comment in issue by schustmi in https://github.com/zenml-io/zenml/pull/181
* Create Visualizers logic by htahir1 in https://github.com/zenml-io/zenml/pull/182
* Add README for visualizers examples by alex-zenml in https://github.com/zenml-io/zenml/pull/184
* Allow None as default value for BaseStep configs by schustmi in https://github.com/zenml-io/zenml/pull/185
* Baris/eng 37 standard import check by bcdurak in https://github.com/zenml-io/zenml/pull/183
* Replace duplicated code by call to source_utils.resolve_class by schustmi in https://github.com/zenml-io/zenml/pull/186
* Remove unused base enum cases by schustmi in https://github.com/zenml-io/zenml/pull/187
* Testing mocks for CLI `examples` command by alex-zenml in https://github.com/zenml-io/zenml/pull/180
* Set the correct module for steps created using our decorator by schustmi in https://github.com/zenml-io/zenml/pull/188
* Fix some cli commands by schustmi in https://github.com/zenml-io/zenml/pull/189
* Tag jira issues for which the todo was deleted by schustmi in https://github.com/zenml-io/zenml/pull/190
* Remove deadlinks by alex-zenml in https://github.com/zenml-io/zenml/pull/191


**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.5.2...0.5.3

creating pipelines. It also improves the Airflow orchestrator logic to accommodate for more real world scenarios. Check out the
[low level API guide for more details!](https://docs.zenml.io/guides/low-level-api)

What's Changed
* Fix autocomplete for step and pipeline decorated functions by schustmi in https://github.com/zenml-io/zenml/pull/144
* Add reference docs for CLI example functionality by alex-zenml in https://github.com/zenml-io/zenml/pull/145
* Fix mypy integration by schustmi in https://github.com/zenml-io/zenml/pull/147
* Improve Post-Execution Workflow by schustmi in https://github.com/zenml-io/zenml/pull/146
* Fix CLI examples bug by alex-zenml in https://github.com/zenml-io/zenml/pull/148
* Update quickstart example notebook by alex-zenml in https://github.com/zenml-io/zenml/pull/150
* Add documentation images by alex-zenml in https://github.com/zenml-io/zenml/pull/151
* Add prettierignore to gitignore by alex-zenml in https://github.com/zenml-io/zenml/pull/154
* Airflow orchestrator improvements by schustmi in https://github.com/zenml-io/zenml/pull/153
* Google colab added by htahir1 in https://github.com/zenml-io/zenml/pull/155
* Tests for `core` and `cli` modules by alex-zenml in https://github.com/zenml-io/zenml/pull/149
* Add Paperspace environment check by alex-zenml in https://github.com/zenml-io/zenml/pull/156
* Step caching by schustmi in https://github.com/zenml-io/zenml/pull/157
* Add documentation for pipeline step parameter and run name configuration by schustmi in https://github.com/zenml-io/zenml/pull/158
* Automatically disable caching if the step function code has changed by schustmi in https://github.com/zenml-io/zenml/pull/159


**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.5.1...0.5.2

0.5.1 builds on top of Slack of the 0.5.0 release with quick bug updates.


Overview

* Pipeline can now be run via a YAML file. 132
* CLI now let's you pull directly from GitHub examples folder. :fire: Amazing alex-zenml with 141!
* ZenML now has full [mypy](http://mypy-lang.org/) compliance. :tada: Thanks schustmi for #140!
* Numerous bugs and performance improvements. 136, bcdurak great job with 142
* Airflow orchestrator now bootstraps airflow locally and spins it up before running pipelines.
* Added new docs with a low level API guide. 143

[Our roadmap](https://docs.zenml.io/support/roadmap) goes into further detail on the timeline. Vote on the [next features now](https://github.com/zenml-io/zenml/discussions).

We encourage every user (old or new) to start afresh with this release. Please go over our latest [docs](https://docs.zenml.io) and [examples](examples) to get a hang of the new system.

Auto-generated docs:
* Some random optimizations by htahir1 in https://github.com/zenml-io/zenml/pull/129
* Add codecov threhold for PRs by schustmi in https://github.com/zenml-io/zenml/pull/131
* remove misspelling of preprocessor by alex-zenml in https://github.com/zenml-io/zenml/pull/134
* Quick edit of documentation by alex-zenml in https://github.com/zenml-io/zenml/pull/133
* Very confusing codecov update by htahir1 in https://github.com/zenml-io/zenml/pull/135
* Small bugs here and there by htahir1 in https://github.com/zenml-io/zenml/pull/136
* Michael/type annotations by schustmi in https://github.com/zenml-io/zenml/pull/137
* Hamza/docs upgrade by htahir1 in https://github.com/zenml-io/zenml/pull/138
* add tests by alex-zenml in https://github.com/zenml-io/zenml/pull/130
* Michael/mypy integration by schustmi in https://github.com/zenml-io/zenml/pull/139
* First version of low level api guide by htahir1 in https://github.com/zenml-io/zenml/pull/140
* CLI examples by alex-zenml in https://github.com/zenml-io/zenml/pull/141
* Implement pipeline configuration with yaml file by schustmi in https://github.com/zenml-io/zenml/pull/132
* Baris/improved performance by bcdurak in https://github.com/zenml-io/zenml/pull/142
* Hamza/docs upgrade by htahir1 in https://github.com/zenml-io/zenml/pull/143


**Full Changelog**: https://github.com/zenml-io/zenml/compare/0.5.0...0.5.1

concepts have been changed, and therefore backwards compatibility is not maintained. Please use only this version
with fresh projects.

With such significant changes, we expect this release to also be breaking. Please report any bugs in the issue board, and
they should be addressed in upcoming releases.

Overview

* Introducing a new functional API for creating pipelines and steps. This is now the default mechanism for building ZenML pipelines. [read more](https://docs.zenml.io/quickstart-guide)
* Steps now use Materializers to handle artifact serialization/deserialization between steps. This is a powerful change, and will be expanded upon in the future. [read more](https://docs.zenml.io/core/materializers)
* Introducing the new `Stack` paradigm: Easily transition from one MLOps stack to the next with a few CLI commands [read more](https://docs.zenml.io/core/stacks)
* Introducing a new `Artifact`, `Typing`, and `Annotation` system, with `pydantic` (and `dataclasses`) support [read more](https://docs.zenml.io/core/artifacts)
* Deprecating the `pipelines_dir`: Now individual pipelines will be stored in their metadata stores, making the metadata store a single source of truth. [read more](https://docs.zenml.io/core/stacks)
* Deprecating the YAML config file: ZenML no longer natively compiles to an intermediate YAML-based representation. Instead, it compiles and deploys directly into the selected orchestrator's
representation. While we do plan to support running pipelines directly through YAML in the future, it will no longer be
the default route through which pipelines are run. [read more about orchestrators here](https://docs.zenml.io/core/stacks)

Technical Improvements
* A completely new system design, please refer to the [docs](https://docs.zenml.io/core/core-concepts).
* Better type hints and docstrings.
* Auto-completion support.
* Numerous performance improvements and bug fixes, including a smaller dependency footprint.

What to expect in the next weeks and the new ZenML
Currently, this release is bare bones. We are missing some basic features which used to be part of ZenML 0.3.8 (the previous release):

* Standard interfaces for `TrainingPipeline`.
* Individual step interfaces like `PreprocesserStep`, `TrainerStep`, `DeployerStep` etc. need to be rewritten from within the new paradigm. They should
be included in the non-RC version of this release.
* A proper production setup with an orchestrator like Airflow.
* A post-execution workflow to analyze and inspect pipeline runs.
* The concept of `Backends` will evolve into a simple mechanism of transitioning individual steps into different runners.
* Support for `KubernetesOrchestrator`, `KubeflowOrchestrator`, `GCPOrchestrator` and `AWSOrchestrator` are also planned.
* Dependency management including Docker support is planned.

[Our roadmap](https://docs.zenml.io/support/roadmap) goes into further detail on the timeline.

We encourage every user (old or new) to start afresh with this release. Please go over our latest [docs](https://docs.zenml.io)
and [examples](examples) to get a hang of the new system.