Dlt

Latest version: v1.4.0

Safety actively analyzes 681866 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 7 of 15

0.3.10

Core Library
* Fix config dataclasses on python 3.11 by steinitzu in https://github.com/dlt-hub/dlt/pull/541
Now P3.11 is fully tested on CI
* removes optional dependencies by rudolfix in https://github.com/dlt-hub/dlt/pull/552
`sentry-sdk` and [several dependencies used by `dlt deploy` command](https://dlthub.com/docs/reference/command-line-interface#dlt-deploy) were moved to extras. several others (including `fsspec`) have their minimal version set to earlier versions
* PR above is also fixing 539 and 540

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.9...0.3.10

0.3.9

Bugfix Release
When a [replace with staging dataset](https://dlthub.com/docs/general-usage/full-loading#the-insert-from-staging-strategy) was used in version 0.3.8, tables with other write dispositions were also truncated (in other words all the tables in the schema could be truncated). Note that default replace strategy does not use staging dataset so if you didn't explicitly changed you were not affected.
This release fixes that bug. If you use the replace strategy above, update the library.

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.8...0.3.9

0.3.8

Core Library
* use Airflow (and possibly other) schedulers with dlt resources by rudolfix in https://github.com/dlt-hub/dlt/pull/534
A really cool feature that allows your incremental loading to take date ranges from Airflow schedulers. [Do backfilling, incremental loading and relay on Airflow to keep the pipeline state](https://dlthub.com/docs/general-usage/incremental-loading#using-airflow-schedule-for-backfill-and-incremental-loading).

* Ignore hints prefixed with 'x-' in table_schema() by burnash in https://github.com/dlt-hub/dlt/pull/525
* Now our CI works correctly from forks! by steinitzu in https://github.com/dlt-hub/dlt/pull/530

Support for unstructured data!
[A really cool data source that let's you ask questions about your PDF documents and stores the answers in any of our destinations](https://github.com/dlt-hub/verified-sources/tree/master/sources/unstructured_data). Going from binary blobs through unstrucutred.io, vector databases and LLM queries to ie. duckdb and bigquery. Blobs coming from filesystem, google drive or your inbox (also incrementally) by AstrakhantsevaAA

0.3.6

Core Library
* fixes lost data and incorrect handling of child tables during `truncate-and-insert` replace by sh-rp in https://github.com/dlt-hub/dlt/pull/499
This is important improvement that fixes a few holes in `truncate-and-insert` replace mode (which was there from beginning of `dlt`). Now we truncate all the tables before multithreaded append process starts. We also truncate child tables that could be left with data before.
details: 263 271

* fixes deploy airflow secrets and makes `toml` the default layout by rudolfix in https://github.com/dlt-hub/dlt/pull/513
* check the required verified source `dlt` version during `dlt init` and warn users by steinitzu in https://github.com/dlt-hub/dlt/pull/514
* add schema version to _dlt_loads table by codingcyclist in https://github.com/dlt-hub/dlt/pull/466

Docs
* Add example values to data types docs by burnash in https://github.com/dlt-hub/dlt/pull/516
* adding destination walkthrough by rudolfix in https://github.com/dlt-hub/dlt/pull/520

New Contributors
* codingcyclist made their first contribution in https://github.com/dlt-hub/dlt/pull/466

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.5...0.3.6

0.3.5

Core Library
* Fix incremental hitting end_value throwing out whole batches by steinitzu in https://github.com/dlt-hub/dlt/pull/495
* replace with staging tables by sh-rp in https://github.com/dlt-hub/dlt/pull/488
Now staging dataset may be used to replace tables. you can chose from several replace strategies (https://dlthub.com/docs/general-usage/full-loading) including fully transactional and atomic replacing of parent and all child tables or optimized where we use ie. ability to clone tables and copy on write in BigQuery and Snowflake

* detect serverless aws_lambda by muppinesh in https://github.com/dlt-hub/dlt/pull/490
* fixes credentials instantiation by rudolfix in https://github.com/dlt-hub/dlt/pull/507
* fixes extract schema update by rudolfix in https://github.com/dlt-hub/dlt/pull/509
* adds destination fingerprint by rudolfix in https://github.com/dlt-hub/dlt/pull/511

Docs
* staging docs update by rudolfix in https://github.com/dlt-hub/dlt/pull/496
* Updates to verified sources by dat-a-man

New Contributors
* muppinesh made their first contribution in https://github.com/dlt-hub/dlt/pull/490

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.4...0.3.5

0.3.4

Core Library
* staging for loader files implemented by sh-rp in https://github.com/dlt-hub/dlt/pull/451
* staging for redshift on s3 bucket and json + parquet by sh-rp in https://github.com/dlt-hub/dlt/pull/451
* staging for bigquery on gs bucket and json + parquet by sh-rp in https://github.com/dlt-hub/dlt/pull/451
* staging for snowflake on s3+gs buckets and json + parquet by sh-rp in https://github.com/dlt-hub/dlt/pull/451
* improvements and bugfixes for parquet generation by rudolfix in https://github.com/dlt-hub/dlt/pull/451
* tracks helpers usage and source names by rudolfix in https://github.com/dlt-hub/dlt/pull/497
* Fix: use sets to prevent unnecessary truncate calls by z3z1ma in https://github.com/dlt-hub/dlt/pull/481

Docs
* staging docs update by sh-rp in https://github.com/dlt-hub/dlt/pull/485
* rewritten documentation for destinations rudolfix AstrakhantsevaAA dat-a-man
* adds category pages for sources and destinations by rudolfix in https://github.com/dlt-hub/dlt/pull/486
* Clarifies create-a-pipeline docs by willi-mueller in https://github.com/dlt-hub/dlt/pull/493

New Contributors
* willi-mueller made their first contribution in https://github.com/dlt-hub/dlt/pull/493

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.3...0.3.4

Page 7 of 15

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.