Dlt

Latest version: v0.4.12

Safety actively analyzes 641049 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 5 of 14

0.3.16

Core Library
* add default user agent header to `dlt` requests client by sh-rp in https://github.com/dlt-hub/dlt/pull/595
* Add issue templates by burnash in https://github.com/dlt-hub/dlt/pull/537
* Add pydantic support by steinitzu in https://github.com/dlt-hub/dlt/pull/589
You can use pydantic to define table schemas. You can load pydantic instances like you can load dictionaries

* retain schema hints order by sh-rp in https://github.com/dlt-hub/dlt/pull/600
* `NormalizerInfo`: item counts in table present in trace by sh-rp in https://github.com/dlt-hub/dlt/pull/582
Get counts of items added to table from normalization stage

* Add azure blob storage filesystem/staging destination by steinitzu in https://github.com/dlt-hub/dlt/pull/592
Also includes Snowflake stage support

* Feat: add time to pua serde by z3z1ma in https://github.com/dlt-hub/dlt/pull/604
* general state sync interface by sh-rp in https://github.com/dlt-hub/dlt/pull/564
You can restore state and schemas from Weaviate now (filesystem comes later)

* uses botocore instead of boto3 in AwsCredentials by rudolfix in https://github.com/dlt-hub/dlt/pull/590

Docs
* Update pseudonymizing_columns.md by wtfzambo in https://github.com/dlt-hub/dlt/pull/598
* Docs: getting started by AstrakhantsevaAA in https://github.com/dlt-hub/dlt/pull/568
We have a really nice getting started now: https://dlthub.com/docs/getting-started

New Verified Sources
* really nice `airtable` source by willi-mueller in https://github.com/dlt-hub/verified-sources/pull/218
thx for amazing contribution!

New Contributors
* wtfzambo made their first contribution in https://github.com/dlt-hub/dlt/pull/599

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.13...0.3.16

0.3.13

Core Library
* Feat: don't require AWS credentials for external Snowflake stage by codingcyclist in https://github.com/dlt-hub/dlt/pull/587
* connecting to local Weaviate made easy by rudolfix in https://github.com/dlt-hub/dlt/pull/591
* allows setting table name via property on DltResource by rudolfix in https://github.com/dlt-hub/dlt/pull/593
* destination tests refactored by sh-rp in https://github.com/dlt-hub/dlt/pull/572

Docs
* docs snippet and examples will be now linted and tested by sh-rp in https://github.com/dlt-hub/dlt/pull/559
* several blog posts and verified sourced docs updates by adrianbr and dat-a-man

New Verified Sources
* MongoDb source working in the same way as sql database by sehnem in https://github.com/dlt-hub/verified-sources/pull/239

New Contributors
* sehnem in https://github.com/dlt-hub/verified-sources/pull/239

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.12...0.3.13

0.3.12

Core Library
In this version we release two new types of a destinations:
* Add a Weaviate destination by burnash in https://github.com/dlt-hub/dlt/pull/479
A vector data store: load and query vectorized text data
* Basic AWS Athena support by sh-rp in https://github.com/dlt-hub/dlt/pull/522
A data lake destination which works together with `filesystem` as a staging

Apart from that bug fixes:
* fixes airflow provider init sequence by rudolfix in https://github.com/dlt-hub/dlt/pull/569
* fixes transformer decorator typings by rudolfix in https://github.com/dlt-hub/dlt/pull/554

Docs
* We improved documentation for many verified sources (thx dat-a-man and AstrakhantsevaAA )
* updates contribution and readme + small docs fixes by rudolfix in https://github.com/dlt-hub/dlt/pull/553
* Edit weaviate docs by hsm207 in https://github.com/dlt-hub/dlt/pull/566

New Contributors
* hsm207 made their first contribution in https://github.com/dlt-hub/dlt/pull/566

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.10...0.3.12

0.3.10

Core Library
* Fix config dataclasses on python 3.11 by steinitzu in https://github.com/dlt-hub/dlt/pull/541
Now P3.11 is fully tested on CI
* removes optional dependencies by rudolfix in https://github.com/dlt-hub/dlt/pull/552
`sentry-sdk` and [several dependencies used by `dlt deploy` command](https://dlthub.com/docs/reference/command-line-interface#dlt-deploy) were moved to extras. several others (including `fsspec`) have their minimal version set to earlier versions
* PR above is also fixing 539 and 540

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.9...0.3.10

0.3.9

Bugfix Release
When a [replace with staging dataset](https://dlthub.com/docs/general-usage/full-loading#the-insert-from-staging-strategy) was used in version 0.3.8, tables with other write dispositions were also truncated (in other words all the tables in the schema could be truncated). Note that default replace strategy does not use staging dataset so if you didn't explicitly changed you were not affected.
This release fixes that bug. If you use the replace strategy above, update the library.

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.3.8...0.3.9

0.3.8

Core Library
* use Airflow (and possibly other) schedulers with dlt resources by rudolfix in https://github.com/dlt-hub/dlt/pull/534
A really cool feature that allows your incremental loading to take date ranges from Airflow schedulers. [Do backfilling, incremental loading and relay on Airflow to keep the pipeline state](https://dlthub.com/docs/general-usage/incremental-loading#using-airflow-schedule-for-backfill-and-incremental-loading).

* Ignore hints prefixed with 'x-' in table_schema() by burnash in https://github.com/dlt-hub/dlt/pull/525
* Now our CI works correctly from forks! by steinitzu in https://github.com/dlt-hub/dlt/pull/530

Support for unstructured data!
[A really cool data source that let's you ask questions about your PDF documents and stores the answers in any of our destinations](https://github.com/dlt-hub/verified-sources/tree/master/sources/unstructured_data). Going from binary blobs through unstrucutred.io, vector databases and LLM queries to ie. duckdb and bigquery. Blobs coming from filesystem, google drive or your inbox (also incrementally) by AstrakhantsevaAA

Page 5 of 14

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.