Dlt

What's Changed
* add computed exhausted property by sh-rp in https://github.com/dlt-hub/dlt/pull/380
* removes the unpickable lambdas from destination caps and updates tests by rudolfix in https://github.com/dlt-hub/dlt/pull/404
* add secrets format option to dlt deploy by sh-rp in https://github.com/dlt-hub/dlt/pull/401
* Feat: Use compression to maximize network and disk space efficiency by z3z1ma in https://github.com/dlt-hub/dlt/pull/415
* 379 round robin pipe iterator by sh-rp in https://github.com/dlt-hub/dlt/pull/421

Docs
* adding article by TongHere in https://github.com/dlt-hub/dlt/pull/411
* GPT Training fix link by TongHere in https://github.com/dlt-hub/dlt/pull/417
* Docs: deploy airflow by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/410
* restructured docs: new **Getting Started** and **dlt Ecosystem** rahuljo in https://github.com/dlt-hub/dlt/pull/398 adrianbr in https://github.com/dlt-hub/dlt/pull/408
* Added Jira Docs by dat-a-man in https://github.com/dlt-hub/dlt/pull/425
* add structured data lake, fix titles by adrianbr in https://github.com/dlt-hub/dlt/pull/419
* adds duckdb->bigquery walkthrough by rudolfix in https://github.com/dlt-hub/dlt/pull/392
* Added sql_database pipeline by dat-a-man in https://github.com/dlt-hub/dlt/pull/396
* Added stripe setup guide by dat-a-man in https://github.com/dlt-hub/dlt/pull/394
* Added Workable pipeline docs by dat-a-man in https://github.com/dlt-hub/dlt/pull/395
* Added salesforce docs by dat-a-man in https://github.com/dlt-hub/dlt/pull/413
* Added Notion Docs by dat-a-man in https://github.com/dlt-hub/dlt/pull/409
* Added Mux docs by dat-a-man in https://github.com/dlt-hub/dlt/pull/412

New Contributors
* TongHere made their first contribution in https://github.com/dlt-hub/dlt/pull/411

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.0...0.3.1

Core Library
* renames Pipelines to Verified Sources by rudolfix in https://github.com/dlt-hub/dlt/pull/382
* adds tests to build containers, removes psutil by rudolfix in https://github.com/dlt-hub/dlt/pull/373
* finalizes where the resource state is stored in pipeline state by rudolfix in https://github.com/dlt-hub/dlt/pull/374
* accepts explicit values for unions if type of value is one of types by rudolfix in https://github.com/dlt-hub/dlt/pull/377
* add quotes to missing dependency exception output by sh-rp in https://github.com/dlt-hub/dlt/pull/387
* Feat/Add transaction management for filesystem operations using fsspec by z3z1ma in https://github.com/dlt-hub/dlt/pull/384

Minor Version Changes
* source name is now the key in pipeline state that stores all the source and resource state. previously the source section (which was the name of python module where source was defined) was used. this change will affect the already deployed pipelines that had name of the source different from the name of the module. they will not see the already stored state and may, for example, load some data twice. the only verified source affected by this is zendesk.

Docs
* rewrites the sections on source, resource and pipeline state by rudolfix in https://github.com/dlt-hub/dlt/pull/376
* minor changes to schema evolution doc by rahuljo in https://github.com/dlt-hub/dlt/pull/372
* pushing experiment 4 blog by rahuljo in https://github.com/dlt-hub/dlt/pull/371
* update docusaurus and fix gtag by sh-rp in https://github.com/dlt-hub/dlt/pull/385
* add section landing pages to docusaurus by sh-rp in https://github.com/dlt-hub/dlt/pull/386


New Contributors
* sh-rp made their first contribution in https://github.com/dlt-hub/dlt/pull/385

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.9...0.3.0

Core Library
* dlt source decomposition into Airflow DAG by rudolfix in https://github.com/dlt-hub/dlt/pull/352
* airflow dlt wrapper to run dlt pipelines as DAGs by rudolfix in https://github.com/dlt-hub/dlt/pull/357
* dlt deploy airflow-composer by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/356
* new destination: filesystem/bucket with fsspec by steinitzu in https://github.com/dlt-hub/dlt/pull/342
* Update deprecated GitHub action by tungbq in https://github.com/dlt-hub/dlt/pull/345
* A base class for vault config providers with two implementations Google Secrets config provider and Airflow config provider

Docs
* pushing experiment 3 blog post by rahuljo in https://github.com/dlt-hub/dlt/pull/361
* structured data lakes post by adrianbr in https://github.com/dlt-hub/dlt/pull/362
* Several fixes and improvements by tungbq

New Contributors
* AstrakhantsevaAA made their first contribution in https://github.com/dlt-hub/dlt/pull/356

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.8...0.2.9

Core Library
* fixes various airflow deployment issues by rudolfix in https://github.com/dlt-hub/dlt/pull/334 that include on-atomic renames on bucket mapped with fuse
* bumps duckdb dependency to include 0.8.0
* Fix/incremental with timezone naive datetime by steinitzu in https://github.com/dlt-hub/dlt/pull/330
* splits schema migration script to fit in max query length by rudolfix in https://github.com/dlt-hub/dlt/pull/339
* `resource_state` got final interface and is now exposed in `dlt.current.resource_state` https://github.com/dlt-hub/dlt/pull/350
* adds transformer overload that may be used when creating transformers dynamically to pass the decorated function
* `source.with_resources` creates a clone of resource and selects in the clone. previously source was modified in place
* you can write back the secrets and configuration using `dlt.config` and `dlt.secrets` indexers

Docs
* improve spaces on code samples by TyDunn in https://github.com/dlt-hub/dlt/pull/325
* Incremental loading image by adrianbr in https://github.com/dlt-hub/dlt/pull/318
* Adding matomo docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/331
* Adding asana dlt setup guide by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/319
* adding experiment 2 blog by rahuljo in https://github.com/dlt-hub/dlt/pull/336
* Fix Broken image in Docs > Pipelines > Google Analytics by tungbq in https://github.com/dlt-hub/dlt/pull/328
* Adding shopify docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/335
* Fixed the broken image link on zendesk page by MirrorCraze in https://github.com/dlt-hub/dlt/pull/337
* Fixed capitalization in docs by burnash in https://github.com/dlt-hub/dlt/pull/341
* Fix typo in docs/pipelines/asana.md by tungbq in https://github.com/dlt-hub/dlt/pull/344
* Fix analytics-engineer.md broken links by tungbq in https://github.com/dlt-hub/dlt/pull/349
* Correct typo in run pipeline guide of shopify.md by tungbq in https://github.com/dlt-hub/dlt/pull/347

New Contributors
* tungbq made their first contribution in https://github.com/dlt-hub/dlt/pull/328
* MirrorCraze made their first contribution in https://github.com/dlt-hub/dlt/pull/337

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.6...0.2.8

Core Library
* An experimental google secrets config provider https://github.com/dlt-hub/dlt/issues/292 (actively used on our CI, goes to GA after adding more tests)
* Several bug fixes for `dlt init` and `dlt pipeline` CLI commands
* We are shifting from pre-releases to patch versions with post-releases for bugfixes and quick iterations to allow upgrades with `pip install -U dlt`

Building Blocks
* add `dlt.sources.credentials` module with reusable credentials by rudolfix in https://github.com/dlt-hub/dlt/pull/315 (google service account, oauth2, database connection string and their base classes available to be used in pipelines)

Docs
* fix redshift docs by TyDunn in https://github.com/dlt-hub/dlt/pull/313
* User guides by adrianbr in https://github.com/dlt-hub/dlt/pull/301
* Updating landing page code snippet by rahuljo in https://github.com/dlt-hub/dlt/pull/314
* Updated README in `pipelines` repo with more building blocks examples and a guide on sharing community pipelines (https://github.com/dlt-hub/pipelines/blob/master/README.md#read-the-docs-on-building-blocks)


**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.6a1...0.2.6

Core library
* Feat/pipeline drop command by steinitzu in https://github.com/dlt-hub/dlt/pull/285
* collectors and progress bars by rudolfix in https://github.com/dlt-hub/dlt/pull/302

Customizations
* Feat/new `add_limit` method for resources by z3z1ma in https://github.com/dlt-hub/dlt/pull/298
* Same method added to sources. overall you can now quickly sample large sources to ie. create example data sets, test your transformations etc. without the need to load everything

Docs
* explains how to set logging level and format by rudolfix in https://github.com/dlt-hub/dlt/pull/297
* ga4 internal dashboard demo blog post by TyDunn in https://github.com/dlt-hub/dlt/pull/299
* Added google_analytics docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/305
* Update README, add contributor's guide by burnash in https://github.com/dlt-hub/dlt/pull/311
* progress bars docs by rudolfix in https://github.com/dlt-hub/dlt/pull/312

New Contributors
* z3z1ma made their first contribution in https://github.com/dlt-hub/dlt/pull/298
* ashish-weblianz made their first contribution in https://github.com/dlt-hub/dlt/pull/306

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.6a0...0.2.6a1