Dlt

Latest version: v1.4.0

Safety actively analyzes 681844 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 9 of 15

0.2.8

Core Library
* fixes various airflow deployment issues by rudolfix in https://github.com/dlt-hub/dlt/pull/334 that include on-atomic renames on bucket mapped with fuse
* bumps duckdb dependency to include 0.8.0
* Fix/incremental with timezone naive datetime by steinitzu in https://github.com/dlt-hub/dlt/pull/330
* splits schema migration script to fit in max query length by rudolfix in https://github.com/dlt-hub/dlt/pull/339
* `resource_state` got final interface and is now exposed in `dlt.current.resource_state` https://github.com/dlt-hub/dlt/pull/350
* adds transformer overload that may be used when creating transformers dynamically to pass the decorated function
* `source.with_resources` creates a clone of resource and selects in the clone. previously source was modified in place
* you can write back the secrets and configuration using `dlt.config` and `dlt.secrets` indexers

Docs
* improve spaces on code samples by TyDunn in https://github.com/dlt-hub/dlt/pull/325
* Incremental loading image by adrianbr in https://github.com/dlt-hub/dlt/pull/318
* Adding matomo docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/331
* Adding asana dlt setup guide by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/319
* adding experiment 2 blog by rahuljo in https://github.com/dlt-hub/dlt/pull/336
* Fix Broken image in Docs > Pipelines > Google Analytics by tungbq in https://github.com/dlt-hub/dlt/pull/328
* Adding shopify docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/335
* Fixed the broken image link on zendesk page by MirrorCraze in https://github.com/dlt-hub/dlt/pull/337
* Fixed capitalization in docs by burnash in https://github.com/dlt-hub/dlt/pull/341
* Fix typo in docs/pipelines/asana.md by tungbq in https://github.com/dlt-hub/dlt/pull/344
* Fix analytics-engineer.md broken links by tungbq in https://github.com/dlt-hub/dlt/pull/349
* Correct typo in run pipeline guide of shopify.md by tungbq in https://github.com/dlt-hub/dlt/pull/347

New Contributors
* tungbq made their first contribution in https://github.com/dlt-hub/dlt/pull/328
* MirrorCraze made their first contribution in https://github.com/dlt-hub/dlt/pull/337

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.6...0.2.8

0.2.6

Core Library
* An experimental google secrets config provider https://github.com/dlt-hub/dlt/issues/292 (actively used on our CI, goes to GA after adding more tests)
* Several bug fixes for `dlt init` and `dlt pipeline` CLI commands
* We are shifting from pre-releases to patch versions with post-releases for bugfixes and quick iterations to allow upgrades with `pip install -U dlt`

Building Blocks
* add `dlt.sources.credentials` module with reusable credentials by rudolfix in https://github.com/dlt-hub/dlt/pull/315 (google service account, oauth2, database connection string and their base classes available to be used in pipelines)

Docs
* fix redshift docs by TyDunn in https://github.com/dlt-hub/dlt/pull/313
* User guides by adrianbr in https://github.com/dlt-hub/dlt/pull/301
* Updating landing page code snippet by rahuljo in https://github.com/dlt-hub/dlt/pull/314
* Updated README in `pipelines` repo with more building blocks examples and a guide on sharing community pipelines (https://github.com/dlt-hub/pipelines/blob/master/README.md#read-the-docs-on-building-blocks)


**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.6a1...0.2.6

0.2.6a1

Core library
* Feat/pipeline drop command by steinitzu in https://github.com/dlt-hub/dlt/pull/285
* collectors and progress bars by rudolfix in https://github.com/dlt-hub/dlt/pull/302

Customizations
* Feat/new `add_limit` method for resources by z3z1ma in https://github.com/dlt-hub/dlt/pull/298
* Same method added to sources. overall you can now quickly sample large sources to ie. create example data sets, test your transformations etc. without the need to load everything

Docs
* explains how to set logging level and format by rudolfix in https://github.com/dlt-hub/dlt/pull/297
* ga4 internal dashboard demo blog post by TyDunn in https://github.com/dlt-hub/dlt/pull/299
* Added google_analytics docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/305
* Update README, add contributor's guide by burnash in https://github.com/dlt-hub/dlt/pull/311
* progress bars docs by rudolfix in https://github.com/dlt-hub/dlt/pull/312

New Contributors
* z3z1ma made their first contribution in https://github.com/dlt-hub/dlt/pull/298
* ashish-weblianz made their first contribution in https://github.com/dlt-hub/dlt/pull/306

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.6a0...0.2.6a1

0.2.6a0

New package name and pip install command
💡 We changed the package name to **dlt**!
sh
pip install dlt


Core library
* PyPI package name: migrate to `dlt` by burnash in https://github.com/dlt-hub/dlt/pull/264
* adds anonymous id to telemetry by rudolfix in https://github.com/dlt-hub/dlt/pull/284
* makes duckdb database to follow current working directory by rudolfix in https://github.com/dlt-hub/dlt/pull/291
* you can disable unique checks in incremental by passing empty tuple as `primary_key` to `dlt.sources.incremental`

Helpers
**a first of series of Airflow helpers and features**: store `secrets.toml` in Airflow Variable and have your credentials injected automatically. same code works locally and in Airflow DAG.
* Add AirflowSecretsTomlProvider by burnash in https://github.com/dlt-hub/dlt/pull/273

Building blocks
When building pipelines you can now use specs that wrap google credentials. we support service credentials and oauth2 credentials, detect default credentials, provide authorization methods etc. info on credentials below will soon be added to our `docs` and some example pipelines.
python
from dlt.common.configuration.specs import GcpClientCredentials, GcpClientCredentialsWithDefault, GcpOAuthCredentials, GcpOAuthCredentialsWithDefault


* Initial commit for adding oauth gcp credentials by redicane in https://github.com/dlt-hub/dlt/pull/254

Docs
* update doc with new alert capability by adrianbr in https://github.com/dlt-hub/dlt/pull/275
* updating the documentation for the section 'Transforming the data' by rahuljo in https://github.com/dlt-hub/dlt/pull/277
* first version of `understanding the tables` content by TyDunn in https://github.com/dlt-hub/dlt/pull/258
* Rename PyPI package to `dlt` in the docs by burnash in https://github.com/dlt-hub/dlt/pull/282
* pushing the new colab demo by rahuljo in https://github.com/dlt-hub/dlt/pull/288
* updates explore/transform the data in Python by rudolfix in https://github.com/dlt-hub/dlt/pull/289
* update a typo in create-a-pipeline.md by Anggi-Permana-Harianja in https://github.com/dlt-hub/dlt/pull/290

New Contributors
* Anggi-Permana-Harianja made their first contribution in https://github.com/dlt-hub/dlt/pull/290
* redicane made their first contribution in https://github.com/dlt-hub/dlt/pull/254

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a32...0.2.6a0

0.2.0

* is your sources and resources, specify required arguments that should come from config/secrets via `dlt.config.value` or `dlt.secrets.value`
* improved `init command` working with next gen of init templates
* gitubpython dep fixed

0.2.0a32

What's Changed in Docs
* moving to new docs structure by TyDunn in https://github.com/dlt-hub/dlt/pull/245
* adds Agolia DocSearch to the dlt docs 🚀 by TyDunn in https://github.com/dlt-hub/dlt/pull/248
* Zendesk pipeline docs by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/222
* Added Hubspot setup guide by AmanGuptAnalytics in https://github.com/dlt-hub/dlt/pull/250
* moving `create a pipeline` to use weatherapi and duckdb by TyDunn in https://github.com/dlt-hub/dlt/pull/255
* first version of `exploring the data` docs page by TyDunn in https://github.com/dlt-hub/dlt/pull/257
* adds schema general usage and schema adjusting walkthrough to docs by rudolfix in https://github.com/dlt-hub/dlt/pull/243
* filling in deploying section by TyDunn in https://github.com/dlt-hub/dlt/pull/262
* Examples for customisations by adrianbr in https://github.com/dlt-hub/dlt/pull/247
*
What's Changed
* Typed pipeline state by steinitzu in https://github.com/dlt-hub/dlt/pull/239
* allows `incremental` to be passed to `resource.apply_hints()` method
* adds `state` property to sources and resources to get actual value of source and resource scoped state
* Fix failing tests for Redshift and PostgreSQL by burnash in https://github.com/dlt-hub/dlt/pull/270
* add resource name to table schema by steinitzu in https://github.com/dlt-hub/dlt/pull/265
* resets the resource scoped state when doing replace on resource
* you can add `Incremental` as a transform step, instead of injecting

**Full Changelog**: https://github.com/dlt-hub/dlt/compare/0.2.0a30...0.2.0a32

Page 9 of 15

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.