- Disable Kroki links by default. New setting disable_kroki=True allows to still default kroki_url to https://kroki.io. Function create_basic_pipedag_config() just has a kroki_url parameter which defaults to None. - Added max_query_print_length parameter to MSSqlTableStore to limit the length of the printed SQL queries. Default is max_query_print_length=500000 characters. - Fix bug when creating a table with the same name as a `Table` given by `ExternalTableReference` in the same stage - New config options for `SQLTableStore`: * `max_concurrent_copy_operations` to limit the number of concurrent copy operations when copying tables between schemas. * `sqlalchemy_pool_size` and `sqlalchemy_pool_timeout` to configure the pool size and timeout for the SQLAlchemy connection pool. * The defaults fix a bug by setting sqlalchemy options to not time out when the first cache invalid task in a stage triggers copying of cache valid tables between schemas and copying takes longer than 30s.
0.7.1
- Fix bug when Reading DECIMAL(precision, scale) columns to pandas task (precision was interpreted like for Float where precision <= 24 leads to float32). Beware that ``isinstance(sa.Float(), sa.Numeric) == True``.
0.7.0
- Rework `TableReference` support: * Rename `TableReference` to `ExternalTableReference` * Add support for `ExternalTableReference` to point to tables in external (i.e. not managed by `pipedag`) schemas. * Remove support for `ExternalTableReference` that points to table in schema of current stage. I.e. `ExternalTableReference` can only point to tables in external schemas. - Support code based configuration (see create_basic_pipedag_config() in README.md example without config file and without docker-compose) - Added NoBlobStore in case you don't want to provide a directory that is created or needs to exist - Fix polars import in `pyproject.toml` when using OS X with rosetta2 - Bug fix ibm_db2 backend: * input tables for SQL queries were not locked
0.6.10
- Fix bug where a `Task` that was declared lazy but provided a `Table` without a query string would always be cache valid. - Improved documentation
0.6.9
- Update dependencies and remove some upper boundaries - Polars dependency moved to >= 0.18.12 due to incompatible interface change - Workaround for duckdb issue: https://github.com/duckdb/duckdb/issues/10322 - Workaround for prefect needing pytz dependency without declaring it on pypi
0.6.8
- Bug fix ibm_db2 backend: * unspecified materialization_details was failing to load configuration - Bug fixes for mssql backend: * SELECT-INTO was invalid for keyword suffix labels: i.e. `SELECT 1 as prefix_FROM` * Raw SQL statements changing database link of connection via `USE` was causing pipedag generated commands to fail