Spooq

Latest version: v3.4.1

Safety actively analyzes 640296 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 3 of 4

3.2.0

-------------------
* [MOD] Add functionality to log cleansed values into separate struct column (column_to_log_cleansed_values)
* [MOD] Add ignore_ambiguous_columns to Mapper
* [MOD] Log spooq version when importing
* [REM] Drop separate spark package (bin-folder) as pip package can now handle all tests as well
* [ADD] Github action to test on label (test-it) or merge into master

3.1.0

-------------------
* [ADD] EnumCleaner Transformer
* [MOD] Add support for dynamic default values with the ThresholdCleaner

3.0.1

-------------------
* [MOD] extended_string_to_timestamp: now keeps milli seconds (no more cast to LongType) for conversion to Timestamp

3.0.0b

-------------------
* [ADD] Spark 3 support (different handling in tests via `only_sparkX` decorators)
* [FIX] Fix null types in schema for custom transformations on missing columns
* [MOD] (BREAKING CHANGE!) set default for `ignore_missing_columns` of Mapper to False (fails on missing input columns)

2.3.0

------------------
* [MOD] extended_string_to_timestamp: it can now handle unix timestamps in seconds and in milliseconds
* [MOD] extended_string_to_date: it can now handle unix timestamps in seconds and in milliseconds

2.2.0

------------------
* [MOD] Add support for prepending and appending mappings on input dataframe (Mapper)
* [MOD] Add support for custom spark sql functions in mapper without injecting methods
* [MOD] Add support for "on"/"off" and "enabled"/"disabled" in extended_string_to_boolean custom mapper transformations
* [ADD] New custom mapper transformations:

- extended_string_to_date
- extended_string_unix_timestamp_ms_to_date
- has_value

Page 3 of 4

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.