Mojap-metadata

- Updated metadata schema to v1.4.0

Changed

- Updated dependencies to allow for python 3.11

Changed

- Added new AWS iceberg converter along with tests

Changed

- Updated project dependencies to align with other packages we heavily use

Changed

- Fixed bug where unpacking complex types (aka types with `<>`) did not correctly return contents of brackets.
- Added parameter `field_sep` to `converters._flatten_and_convert_complex_data_type` as Glue schemas fail if spaces are in complex data type definitions. Glue schemas now have no spaces before or after `,` when creating complex data types.

Changed

- Extended pyarrow dependency to v4
- Metadata now allows for `bool` as an alias for `bool_` and `list` as an alias for `list_`. Works with all Converters.

Added

- Metadata methods that can alter columns property in Metadata class. These are `column_names`, `update_column` and `remove_column` - see README for more details.
- Metadata property that forces the location of partitions `force_partition_order` - see README for more details.
- `ArrowConverter` now has a `generate_to_meta` method.