Pydiverse-pipedag

Latest version: v0.9.8

Safety actively analyzes 685525 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 6

0.9.8

- Bugfix for `inputs` argument for `flow.run()`.

0.9.7

- Add support for passing `inputs` for tasks returning multiple Tables and for `RawSql` tasks.

0.9.6

- Support ExternalTableReference creation at flow wiring time. A pipedag `Table(ExternalTableReference(...))` object can
be passed as a parameter into any task instead of any other pipedag table reference.
- Fixed bug that caused a crash when retrieving a polars dataframe from SQL using polars >= 1
- Fix warning about `ignore_position_hashes` being printed even if the flag was not set.
- Added support for `inputs` argument for `flow.run()` allowing to pass `ExternalTableReference`
objects to the flow that override the outputs of selected tasks.

0.9.5

- Fixed a bug in primary key generation when materializing pandas dataframe to postgres database

0.9.4

- Primary key and index identifiers are now automatically truncated to 63 characters to avoid issues with some database systems.
- Added `ignore_position_hashes` option to `flow.run()` and `get_output_from_store()`.
If `True`, the position hashes of tasks are not checked when retrieving the inputs of a task from the cache.
This can prevent caching errors when evaluating subgraphs.
For this to work a task may never be used more than once per stage.
- Fixed a bug related to imperative materialization

0.9.3

- Added `upload_table()` and `download_table()` functions to the PandasTableHook to allow for easy
customization of up and download behavior of pandas and polars tables from/to the table store.
- More robust way of looking up hooks independent of import order. Subclasses of table stores don't
copy registered hooks in the moment of declaration. When registering a hook it is possible now, to
specify the hooks that are replaced by a new registration.

Page 1 of 6

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.