Dlt

New package name and pip install command
💡 We changed the package name to **dlt**!
sh
pip install dlt


Core library
* PyPI package name: migrate to `dlt` by burnash in https://github.com/dlt-hub/dlt/pull/264
* adds anonymous id to telemetry by rudolfix in https://github.com/dlt-hub/dlt/pull/284
* makes duckdb database to follow current working directory by rudolfix in https://github.com/dlt-hub/dlt/pull/291
* you can disable unique checks in incremental by passing empty tuple as `primary_key` to `dlt.sources.incremental`

Helpers
**a first of series of Airflow helpers and features**: store `secrets.toml` in Airflow Variable and have your credentials injected automatically. same code works locally and in Airflow DAG.
* Add AirflowSecretsTomlProvider by burnash in https://github.com/dlt-hub/dlt/pull/273

Building blocks
When building pipelines you can now use specs that wrap google credentials. we support service credentials and oauth2 credentials, detect default credentials, provide authorization methods etc. info on credentials below will soon be added to our `docs` and some example pipelines.
python
from dlt.common.configuration.specs import GcpClientCredentials, GcpClientCredentialsWithDefault, GcpOAuthCredentials, GcpOAuthCredentialsWithDefault


* Initial commit for adding oauth gcp credentials by redicane in https://github.com/dlt-hub/dlt/pull/254

Docs
* update doc with new alert capability by adrianbr in https://github.com/dlt-hub/dlt/pull/275
* updating the documentation for the section 'Transforming the data' by rahuljo in https://github.com/dlt-hub/dlt/pull/277
* first version of `understanding the tables` content by TyDunn in https://github.com/dlt-hub/dlt/pull/258
* Rename PyPI package to `dlt` in the docs by burnash in https://github.com/dlt-hub/dlt/pull/282
* pushing the new colab demo by rahuljo in https://github.com/dlt-hub/dlt/pull/288
* updates explore/transform the data in Python by rudolfix in https://github.com/dlt-hub/dlt/pull/289
* update a typo in create-a-pipeline.md by Anggi-Permana-Harianja in https://github.com/dlt-hub/dlt/pull/290

New Contributors
* Anggi-Permana-Harianja made their first contribution in https://github.com/dlt-hub/dlt/pull/290
* redicane made their first contribution in https://github.com/dlt-hub/dlt/pull/254

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a32...0.2.6a0

* is your sources and resources, specify required arguments that should come from config/secrets via `dlt.config.value` or `dlt.secrets.value`
* improved `init command` working with next gen of init templates
* gitubpython dep fixed

What's Changed in Docs
* moving to new docs structure by TyDunn in https://github.com/dlt-hub/dlt/pull/245
* adds Agolia DocSearch to the dlt docs 🚀 by TyDunn in https://github.com/dlt-hub/dlt/pull/248
* Zendesk pipeline docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/222
* Added Hubspot setup guide by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/250
* moving `create a pipeline` to use weatherapi and duckdb by TyDunn in https://github.com/dlt-hub/dlt/pull/255
* first version of `exploring the data` docs page by TyDunn in https://github.com/dlt-hub/dlt/pull/257
* adds schema general usage and schema adjusting walkthrough to docs by rudolfix in https://github.com/dlt-hub/dlt/pull/243
* filling in deploying section by TyDunn in https://github.com/dlt-hub/dlt/pull/262
* Examples for customisations by adrianbr in https://github.com/dlt-hub/dlt/pull/247
*
What's Changed
* Typed pipeline state by steinitzu in https://github.com/dlt-hub/dlt/pull/239
* allows `incremental` to be passed to `resource.apply_hints()` method
* adds `state` property to sources and resources to get actual value of source and resource scoped state
* Fix failing tests for Redshift and PostgreSQL by burnash in https://github.com/dlt-hub/dlt/pull/270
* add resource name to table schema by steinitzu in https://github.com/dlt-hub/dlt/pull/265
* resets the resource scoped state when doing replace on resource
* you can add `Incremental` as a transform step, instead of injecting

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a30...0.2.0a32

What's Changed
This release includes two important features
* `merge` write disposition: load data incrementally by merging with merge keys and/or deduplicate/upsert with primary keys
* incremental loading with last value and `dlt` state available when declaring resources
We consider those features still in alpha. Try them out and report bugs! Preliminary documentation is here: https://dlthub.com/docs/customization/incremental-loading

This release includes improved support for resources that use dynamic hint to dispatch data to several database tables and other bug fixes.

What's Changed in docs
* Strapi setup guide by TyDunn in https://github.com/dlt-hub/dlt/pull/212
* add `edit this page` button on all docs pages by TyDunn in https://github.com/dlt-hub/dlt/pull/226
* adding alerting content from workshop by TyDunn in https://github.com/dlt-hub/dlt/pull/233
* adding monitoring content from workshop by TyDunn in https://github.com/dlt-hub/dlt/pull/229
* adding the chess pipeline documentation by rahuljo in https://github.com/dlt-hub/dlt/pull/237
* adds deduplication of staging dataset during merge by rudolfix in https://github.com/dlt-hub/dlt/pull/240

New Contributors
* rahuljo made their first contribution in https://github.com/dlt-hub/dlt/pull/237

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a29...0.2.0a30

What's Changed
* Allow changing `write_disposition` in the resource without dropping dataset by burnash in https://github.com/dlt-hub/dlt/pull/205
* Add a suffix to the default dataset name by burnash in https://github.com/dlt-hub/dlt/pull/207
* improves and adds several `dlt pipeline` commands: `info`, `trace`, `load-package`, `failed-jobs` and `sync` (https://dlthub.com/docs/command-line-interface#dlt-pipeline)
* extends `LoadInfo` to include the schema changes applied to destination and a list of loaded package infos (https://dlthub.com/docs/running-in-production/running#inspect-save-and-alert-on-schema-changes)
* extends load info with `raise_on_failed_jobs` and `has_failed_jobs` to make handling failed jobs easier
* `LoadInfo` and `pipeline.last_trace` can be directly loaded into destination to store more metadata on each load (https://dlthub.com/docs/running-in-production/running#inspect-and-save-the-load-info-and-trace)
* adds retry strategy for `tenacity` to retry `load` pipeline step (or any other per request) (https://dlthub.com/docs/running-in-production/running#handle-exceptions-failed-jobs-and-retry-the-pipeline)
* `raise_on_failed_jobs` config option aborts the load package on first failed jobs (https://dlthub.com/docs/running-in-production/running#failed-jobs)

What's Changed in `docs`
* Fix typos and wording in docs/concepts/state by burnash in https://github.com/dlt-hub/dlt/pull/200
* Fix a broken link in README.md by burnash in https://github.com/dlt-hub/dlt/pull/203
* replacing team with community by TyDunn in https://github.com/dlt-hub/dlt/pull/211
* GitHub and Google Sheets setup guides by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/195
* "run a pipeline" troubleshooting & walkthrough https://dlthub.com/docs/walkthroughs/run-a-pipeline
* "run a pipeline in production": https://dlthub.com/docs/running-in-production/running
* `dlt pipeline` command: https://dlthub.com/docs/command-line-interface#dlt-pipeline



**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a28...0.2.0a29

What's Changed
* transform functions may be added to the resources ie. map, filters and generators. https://dlthub.com/docs/concepts/resource#filter-transform-and-pivot-data
* resources can be added to instantiated sources ie. to enrich data https://dlthub.com/docs/concepts/resource#feeding-data-from-one-resource-into-another and https://dlthub.com/docs/concepts/source#add-more-resources-to-existing-source

Docs
* improve explanations by adrianbr in https://github.com/dlt-hub/dlt/pull/181
* docs: init from other sources by adrianbr in https://github.com/dlt-hub/dlt/pull/182
* operation duck blog post by TyDunn in https://github.com/dlt-hub/dlt/pull/185
* added setup_guide_pipedrive to pipelines folder by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/183
* Docs orchestrators by adrianbr in https://github.com/dlt-hub/dlt/pull/166
* fix typo: add a space after gen(10) by burnash in https://github.com/dlt-hub/dlt/pull/196
* adds transform docs by rudolfix in https://github.com/dlt-hub/dlt/pull/192

New Contributors
* AmanGuptAnalytics made their first contribution in https://github.com/dlt-hub/dlt/pull/183
* burnash made their first contribution in https://github.com/dlt-hub/dlt/pull/196

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a26...0.2.0a28