Pydiverse-pipedag

Latest version: v0.9.10

Safety actively analyzes 723158 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 6

0.7.2

- Disable Kroki links by default. New setting disable_kroki=True allows to still default kroki_url to https://kroki.io.
Function create_basic_pipedag_config() just has a kroki_url parameter which defaults to None.
- Added max_query_print_length parameter to MSSqlTableStore to limit the length of the printed SQL queries.
Default is max_query_print_length=500000 characters.
- Fix bug when creating a table with the same name as a `Table` given by `ExternalTableReference` in the same stage
- New config options for `SQLTableStore`:
* `max_concurrent_copy_operations` to limit the number of concurrent copy operations when copying tables between schemas.
* `sqlalchemy_pool_size` and `sqlalchemy_pool_timeout` to configure the pool size and timeout for the SQLAlchemy connection pool.
* The defaults fix a bug by setting sqlalchemy options to not time out when the first cache invalid task in a stage triggers
copying of cache valid tables between schemas and copying takes longer than 30s.

0.7.1

- Fix bug when Reading DECIMAL(precision, scale) columns to pandas task (precision was interpreted like for Float where
precision <= 24 leads to float32). Beware that ``isinstance(sa.Float(), sa.Numeric) == True``.

0.7.0

- Rework `TableReference` support:
* Rename `TableReference` to `ExternalTableReference`
* Add support for `ExternalTableReference` to point to tables in external (i.e. not managed by `pipedag`) schemas.
* Remove support for `ExternalTableReference` that points to table in schema of current stage. I.e. `ExternalTableReference` can only point to tables in external schemas.
- Support code based configuration (see create_basic_pipedag_config() in README.md example without config file and without docker-compose)
- Added NoBlobStore in case you don't want to provide a directory that is created or needs to exist
- Fix polars import in `pyproject.toml` when using OS X with rosetta2
- Bug fix ibm_db2 backend:
* input tables for SQL queries were not locked

0.6.10

- Fix bug where a `Task` that was declared lazy but provided a `Table` without a query string would always be cache valid.
- Improved documentation

0.6.9

- Update dependencies and remove some upper boundaries
- Polars dependency moved to >= 0.18.12 due to incompatible interface change
- Workaround for duckdb issue: https://github.com/duckdb/duckdb/issues/10322
- Workaround for prefect needing pytz dependency without declaring it on pypi

0.6.8

- Bug fix ibm_db2 backend:
* unspecified materialization_details was failing to load configuration
- Bug fixes for mssql backend:
* SELECT-INTO was invalid for keyword suffix labels: i.e. `SELECT 1 as prefix_FROM`
* Raw SQL statements changing database link of connection via `USE` was causing pipedag generated commands to fail

Page 3 of 6

© 2025 Safety CLI Cybersecurity Inc. All Rights Reserved.