Aws-insurancelake-infrastructure

Latest version: v4.1.2

Safety actively analyzes 681775 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 2

4.1.2

Documentation updates

4.1.0

InsuranceLake 4.1.0 Release includes:
- [Online documentation through GitHub pages](https://aws-solutions-library-samples.github.io/aws-insurancelake-etl/) launched (improved navigation, search, and formatting)
- Documentation for [Building Dependent Workflows](https://aws-solutions-library-samples.github.io/aws-insurancelake-etl/loading_data/#building-dependent-workflows)
- Documentation and code support for [EventBridge events from AWS Glue Data Quality warn rules](https://aws-solutions-library-samples.github.io/aws-insurancelake-etl/data_quality/#warn)
- [XML input file format support](https://aws-solutions-library-samples.github.io/aws-insurancelake-etl/file_formats/#xml)
- [JSON structured](https://aws-solutions-library-samples.github.io/aws-insurancelake-etl/transforms/#jsonstructured), and [XML structured](https://aws-solutions-library-samples.github.io/aws-insurancelake-etl/transforms/#xmlstructured) column transforms (convert string column to structured column)
- FIX: Cloud9 replaced with CloudShell for Quickstart instructions

4.0.3

InsuranceLake v4.0.3 release includes:
- Pipe-delimited and custom delimiter source file support
- Documentation formatting and content improvements

4.0

InsuranceLake Version 4.0 includes:
- Iceberg support in entity matching Glue job
- Partition override support via Collect bucket folder path
- Evolve schema control option fully implemented
- Quarantine partitions/catalog entries are now created and cleared on each job execution making it possible to use quarantine tables as targets before quarantining any rows, and to rerun executions to correct quarantined data
- Transforms can be run more than once using an optional suffix (thank you to Paolo Rezzano for the suggestion and code snippet)
- Merge transform supports handling empty strings as nulls
- Lambda function version bump to 3.12 and removal of aws-cdk-lib version constraint
- Custom Lineage module performance improvements
- Introduce data lineage to entity match Glue job
- Enable unit testing with Iceberg in entity match Glue job, and provide documentation
- 80% unit test coverage
- Documentation updates include: Glue Data Quality AI recommendations, Guidance for multi-file/nested folder Parquet files, Guidance for encoding issues in Fixed Width files, Guidance on writing performant Spark transforms, Schema evolution support details, Guidance on loading data for the first time, Improved Code Security information
- FIX: Clear partitions correctly (reverts previous release, and improves)
- FIX: Increase allowed Lambda function execution time

3.2

Documentation and resiliency updates

3.1

Sync requirements.txt with ETL repository

Page 1 of 2

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.