Etlrules

Latest version: v0.3.2

Safety actively analyzes 623642 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

0.3.2

* Add option to skip rows from the top of a csv file for the csv read rule
* Add support for reading/writing compressed csv files for the polars backend
* Support reading csv files via http and https
* Read csv files in one block in dask

0.3.1

What's Changed
* Initial attempt to remove polars_business and implement vectorized business offsets by ciprianmiclaus in https://github.com/ciprianmiclaus/etlrules/pull/8


**Full Changelog**: https://github.com/ciprianmiclaus/etlrules/compare/v0.3.0...v0.3.1

0.3.0

* Add support for dask backend
* Ability to deserialize custom rules (ie not part of the etlrules package) to support users implementing their own rules

0.2.3

* Fix to apply substitution in the WriteSQLTableRule sql_engine parameter
* Apply substitution in the Read/Write rules for csv and parquet files for the file_name and file_dir parameters
* Add a cli runner which allows users to run a yml file and parameterize with cli args the plan context
* Add the csv2db plan/yml example
* Add the db2csv plan/yml example
* Remove poetry

0.2.2

* Support environment variables substitution in the sql_engine string for SQL rules
* Add support for the Boolean type
* Introduce the concept of a plan context, consisting of a key-value mapping of string to int/float/str/bool values
which will act as the args into the plan. They can be used in expressions when adding new columns, ifthenelse and
filter rules.
* Add env and context substitution feature to sql queries

0.2.1

* Add support for unsigned int types
* Add AddRowNumbersRule, a rule to add row numbers
* Add ExplodeValuesRule which explode lists of values into individual scalar values as additional rows
* Add support for reading/writing to/from DBs via sqlalchemy under etlrules.backends.common.io.db

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.