Python-dlt

Latest version: v0.2.1

Safety actively analyzes 681812 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 7

0.2.0

* is your sources and resources, specify required arguments that should come from config/secrets via `dlt.config.value` or `dlt.secrets.value`
* improved `init command` working with next gen of init templates
* gitubpython dep fixed

0.2.0a32

What's Changed in Docs
* moving to new docs structure by TyDunn in https://github.com/dlt-hub/dlt/pull/245
* adds Agolia DocSearch to the dlt docs 🚀 by TyDunn in https://github.com/dlt-hub/dlt/pull/248
* Zendesk pipeline docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/222
* Added Hubspot setup guide by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/250
* moving `create a pipeline` to use weatherapi and duckdb by TyDunn in https://github.com/dlt-hub/dlt/pull/255
* first version of `exploring the data` docs page by TyDunn in https://github.com/dlt-hub/dlt/pull/257
* adds schema general usage and schema adjusting walkthrough to docs by rudolfix in https://github.com/dlt-hub/dlt/pull/243
* filling in deploying section by TyDunn in https://github.com/dlt-hub/dlt/pull/262
* Examples for customisations by adrianbr in https://github.com/dlt-hub/dlt/pull/247
*
What's Changed
* Typed pipeline state by steinitzu in https://github.com/dlt-hub/dlt/pull/239
* allows `incremental` to be passed to `resource.apply_hints()` method
* adds `state` property to sources and resources to get actual value of source and resource scoped state
* Fix failing tests for Redshift and PostgreSQL by burnash in https://github.com/dlt-hub/dlt/pull/270
* add resource name to table schema by steinitzu in https://github.com/dlt-hub/dlt/pull/265
* resets the resource scoped state when doing replace on resource
* you can add `Incremental` as a transform step, instead of injecting

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a30...0.2.0a32

0.2.0a30

What's Changed
This release includes two important features
* `merge` write disposition: load data incrementally by merging with merge keys and/or deduplicate/upsert with primary keys
* incremental loading with last value and `dlt` state available when declaring resources
We consider those features still in alpha. Try them out and report bugs! Preliminary documentation is here: https://dlthub.com/docs/customization/incremental-loading

This release includes improved support for resources that use dynamic hint to dispatch data to several database tables and other bug fixes.

What's Changed in docs
* Strapi setup guide by TyDunn in https://github.com/dlt-hub/dlt/pull/212
* add `edit this page` button on all docs pages by TyDunn in https://github.com/dlt-hub/dlt/pull/226
* adding alerting content from workshop by TyDunn in https://github.com/dlt-hub/dlt/pull/233
* adding monitoring content from workshop by TyDunn in https://github.com/dlt-hub/dlt/pull/229
* adding the chess pipeline documentation by rahuljo in https://github.com/dlt-hub/dlt/pull/237
* adds deduplication of staging dataset during merge by rudolfix in https://github.com/dlt-hub/dlt/pull/240

New Contributors
* rahuljo made their first contribution in https://github.com/dlt-hub/dlt/pull/237

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a29...0.2.0a30

0.2.0a29

What's Changed
* Allow changing `write_disposition` in the resource without dropping dataset by burnash in https://github.com/dlt-hub/dlt/pull/205
* Add a suffix to the default dataset name by burnash in https://github.com/dlt-hub/dlt/pull/207
* improves and adds several `dlt pipeline` commands: `info`, `trace`, `load-package`, `failed-jobs` and `sync` (https://dlthub.com/docs/command-line-interface#dlt-pipeline)
* extends `LoadInfo` to include the schema changes applied to destination and a list of loaded package infos (https://dlthub.com/docs/running-in-production/running#inspect-save-and-alert-on-schema-changes)
* extends load info with `raise_on_failed_jobs` and `has_failed_jobs` to make handling failed jobs easier
* `LoadInfo` and `pipeline.last_trace` can be directly loaded into destination to store more metadata on each load (https://dlthub.com/docs/running-in-production/running#inspect-and-save-the-load-info-and-trace)
* adds retry strategy for `tenacity` to retry `load` pipeline step (or any other per request) (https://dlthub.com/docs/running-in-production/running#handle-exceptions-failed-jobs-and-retry-the-pipeline)
* `raise_on_failed_jobs` config option aborts the load package on first failed jobs (https://dlthub.com/docs/running-in-production/running#failed-jobs)

What's Changed in `docs`
* Fix typos and wording in docs/concepts/state by burnash in https://github.com/dlt-hub/dlt/pull/200
* Fix a broken link in README.md by burnash in https://github.com/dlt-hub/dlt/pull/203
* replacing team with community by TyDunn in https://github.com/dlt-hub/dlt/pull/211
* GitHub and Google Sheets setup guides by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/195
* "run a pipeline" troubleshooting & walkthrough https://dlthub.com/docs/walkthroughs/run-a-pipeline
* "run a pipeline in production": https://dlthub.com/docs/running-in-production/running
* `dlt pipeline` command: https://dlthub.com/docs/command-line-interface#dlt-pipeline



**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a28...0.2.0a29

0.2.0a28

What's Changed
* transform functions may be added to the resources ie. map, filters and generators. https://dlthub.com/docs/concepts/resource#filter-transform-and-pivot-data
* resources can be added to instantiated sources ie. to enrich data https://dlthub.com/docs/concepts/resource#feeding-data-from-one-resource-into-another and https://dlthub.com/docs/concepts/source#add-more-resources-to-existing-source

Docs
* improve explanations by adrianbr in https://github.com/dlt-hub/dlt/pull/181
* docs: init from other sources by adrianbr in https://github.com/dlt-hub/dlt/pull/182
* operation duck blog post by TyDunn in https://github.com/dlt-hub/dlt/pull/185
* added setup_guide_pipedrive to pipelines folder by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/183
* Docs orchestrators by adrianbr in https://github.com/dlt-hub/dlt/pull/166
* fix typo: add a space after gen(10) by burnash in https://github.com/dlt-hub/dlt/pull/196
* adds transform docs by rudolfix in https://github.com/dlt-hub/dlt/pull/192

New Contributors
* AmanGuptAnalytics made their first contribution in https://github.com/dlt-hub/dlt/pull/183
* burnash made their first contribution in https://github.com/dlt-hub/dlt/pull/196

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a26...0.2.0a28

0.2.0a26

What's Changed
* adds anonymous telemetry https://dlthub.com/docs/reference/telemetry
* adds pipeline and exception tracing with sentry https://dlthub.com/docs/reference/tracing

Page 1 of 7

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.