Dlt

🧪 pre-release of 0.4.x (do not use in production)
* Parametrized destinations by steinitzu in https://github.com/dlt-hub/dlt/pull/746
* schema contract by sh-rp in https://github.com/dlt-hub/dlt/pull/594
* source and schema changes by sh-rp in https://github.com/dlt-hub/dlt/pull/769
* introduce black formatting by sh-rp in https://github.com/dlt-hub/dlt/pull/583
* docs updates by sh-rp in https://github.com/dlt-hub/dlt/pull/784
* documents schema and data contract by rudolfix in https://github.com/dlt-hub/dlt/pull/782
* Fix: ensure accessor typing does not make static type checker error by z3z1ma in https://github.com/dlt-hub/dlt/pull/785
* prototype platform connection by sh-rp in https://github.com/dlt-hub/dlt/pull/727

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.24...0.4.1a0

Core Library
* Add authenticator to SnowflakeCredentials class by gjdevincentis in https://github.com/dlt-hub/dlt/pull/734
* Set port correctly in mssql connection string by steinitzu in https://github.com/dlt-hub/dlt/pull/731
* Empty rows fix by steinitzu in https://github.com/dlt-hub/dlt/pull/745
* Nit: Remove py.typed file that makes Pyright incessant by z3z1ma in https://github.com/dlt-hub/dlt/pull/732
* adds more name hashes to telemetry by rudolfix in https://github.com/dlt-hub/dlt/pull/764
* Autodetector for ISO date strings by codingcyclist in https://github.com/dlt-hub/dlt/pull/767
* pipeline: drop pending packages by rudolfix in https://github.com/dlt-hub/dlt/pull/771

Docs
* Copy improvements in the SQL Database verified source by anuunchin in https://github.com/dlt-hub/dlt/pull/749
* Docs: add Examples contributing doc by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/743
* Example: nested mongo data by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/737
* Documents how to use dbt wrapper without pipeline by rudolfix in https://github.com/dlt-hub/dlt/pull/733

New Contributors
* gjdevincentis made their first contribution in https://github.com/dlt-hub/dlt/pull/734
* anuunchin made their first contribution in https://github.com/dlt-hub/dlt/pull/749

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.24...0.3.25

Core Library
* Show many schemas in embedded streamlit app by deeplook in https://github.com/dlt-hub/dlt/pull/690
* Qdrant destination support by Anush008 in https://github.com/dlt-hub/dlt/pull/724

New Contributors
* hibajamal made their first contribution in https://github.com/dlt-hub/dlt/pull/728
* deeplook made their first contribution in https://github.com/dlt-hub/dlt/pull/690
* Anush008 made their first contribution in https://github.com/dlt-hub/dlt/pull/724

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.23...0.3.24

Core Library
* Replace multiprocessing pool with futures executors. Now you can run multi-thread code on Lambda (no more semaphore problems) by steinitzu in https://github.com/dlt-hub/dlt/pull/719
* Support all writer types in parquet normalizer. You can load Arrow/Pandas to any destination by steinitzu in https://github.com/dlt-hub/dlt/pull/704
* Add `_dlt_load_id` and `_dlt_id` when loading Arrow/Pandas. steinitzu in https://github.com/dlt-hub/dlt/pull/704
* Pass Arrow/Pandas as data to run method. No need to wrap them in resources. by rudolfix in https://github.com/dlt-hub/dlt/pull/723

Docs
* filesystem/bucket verified source docs by dat-a-man in https://github.com/dlt-hub/dlt/pull/712
* in depth explanation of `dlt` config and secrets! by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/703
* new example: running chess pipeline in production with retries, trace saving and slack messages by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/711

Sources
* Simple, incremental Kinesis reader by sehnem https://github.com/dlt-hub/verified-sources/pull/276

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.22...0.3.23

Core Library
* Fix: make Load single-thread compatible by codingcyclist in https://github.com/dlt-hub/dlt/pull/698
* Enable compatible s3 storages like R2: support aws config `endpoint_url` with fsspec by steinitzu in https://github.com/dlt-hub/dlt/pull/701
* performance improvements in Arrow loading by rudolfix in https://github.com/dlt-hub/dlt/pull/707
* datatype autodetection for unix timestamp removed from defaults by rudolfix in https://github.com/dlt-hub/dlt/pull/707

Docs
* code example: use connectorx + arrow + dlt to load sql data by rudolfix in https://github.com/dlt-hub/dlt/pull/707

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.21...0.3.22

What's Changed
* athena iceberg by sh-rp in https://github.com/dlt-hub/dlt/pull/659
Use new table hint **table format** to store selected Athena tables in iceberg format (https://dlthub.com/docs/dlt-ecosystem/destinations/athena#iceberg-data-tables)

* Pyarrow direct loading by steinitzu and tomsej in https://github.com/dlt-hub/dlt/pull/679
Allows to pass Arrow tables and Panda frames to the `run` method and load them directly (via parquet) without data copy (https://dlthub.com/docs/dlt-ecosystem/verified-sources/arrow-pandas) which should result in immense speedups in many loading cases

* Features/dbt cloud by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/694
Run dbt jobs in the cloud (https://dlthub.com/docs/dlt-ecosystem/transformations/dbt/dbt_cloud)

* enables duckdb 0.9.1 and improves motherduck docs by rudolfix in https://github.com/dlt-hub/dlt/pull/695
Please also read Motherduck updated documentation (https://dlthub.com/docs/dlt-ecosystem/destinations/motherduck) - you may want to reduce load parallelism if you are on weak internet connection

* allows to provide custom implementation of `DltSource` to the source decorator by rudolfix in https://github.com/dlt-hub/dlt/pull/687

Bugfixes
* change source schema handling and normalizer `root_key` propagation. fixes various problems where **merge** and **replace** write dispositions were subsequently used in the same pipeline by sh-rp in https://github.com/dlt-hub/dlt/pull/686
* fixes bug in drop command by sh-rp in https://github.com/dlt-hub/dlt/pull/693

Docs
* Refactor documentation structure by burnash in https://github.com/dlt-hub/dlt/pull/672

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.19...0.3.21