Etl-manager

Latest version: v7.6.0

Safety actively analyzes 634631 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 5 of 6

2.1.2

Added

- DatabaseMeta method function `test_column_types_align` now tests that all column types match across all tables in database object.

2.1.1

Fix

- bug meant that new nullable column property was only being set if nullable was True.

2.1.0

Change

- now allows newline json files as athena compatable tables (note still does not support struct or array column types - still on the todo list)
- Improved `delete_glue_database` method function to only catch/allow specific error (database does not exist)

2.0.0

Change

- Meta data cols now has `enum`, `pattern` and `nullable` properties
- `wait_for_completition` method function now has verbose input param that prints out status with time stamp everytime boto checks on the glue job
- `update_column` method function of `TableMeta` class now takes kwargs that match the properties of the column. (Input params of `new_type`, `new_name`, etc will no longer work). e.g. new functionality works as `tab.update_column('col1', type = 'int')`.

1.0.5

Change

- Changed back end execution of `MSK REPAIR TABLE` call to athena. Have moved from `pyathenajdbc` to `boto3` to reduce number of package dependencies. etl_manager no longer requires `pyathenajdbc` (which also means do not need Java installed).

1.0.4

Change

- removed check that throws error for `-` in job parameter name due to the new Glue parameter `enable-metrics`

Page 5 of 6

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.