- Added the ability to automatically generate a TableMeta object from parquet metadata, using `tablemeta_from_parquet_meta`
7.0.4
Change
- Added the ability to update an existing database with new tables - see `` and `meta.get_existing_database_from_glue_catalogue` and `DatabaseMeta.update_glue_database` - Fixed bug that meant the use of complex types (arrays and structs) didn't actually work in Athena
7.0.3
Change
- Users can now include jars in a `glue_jars` folder, and they will be uploaded to s3 and made available in the glue environment
7.0.2
Change
- GlueJob now sets a timeout parameter for glue jobs. This can set to specific times (in minutes) using the `timeout_override_minutes` property - Relaxed package requirements on jsonschema - Removed `requirements.txt` as no longer used
7.0.1
Change
- Removing validator from column description as it was too strict.
7.0.0
Change
- ETL Manager now points to a web schema for tables (will get schema from package if cannot access schema web link - but will output warning) - Updated package setup to `pyproject.toml` - Replaced travis for github actions