Localstack

New Features & Services

- Initial support for a new Pinpoint provider, supporting basic CRUD operations surrounding AWS Pinpoint. (🌟 pro)
- Initial support for a new Textract provider, supporting basic CRUD operations surrounding AWS Textract. (🌟 pro)
- EventBridge now supports [Input Transformation](https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-transform-target-input.html). This allows customization of the text from an event before it is passed to the target specified by the respective rule.

Enhancements

- LocalStack is now more intelligent about printing download progress debug messages when the `DEBUG` flag is configured.
- OpenSearch now supports v2.11.
- CloudWatch now supports additional regex filter patterns.
- Cognito now supports Pre token generation Lambda `V2_0` trigger event. (🌟 pro)
- EventBridge Pipes is being continuously improved. It now features: (🌟 pro)
- Basic poller for DynamoDB streams and SNS sender.
- Improvements to batching and concurrency.
- CloudWatch logging.
- EC2 instance IP address can now be obtained from `DescribeInstances` or `RunInstances` API. This will make it easier to set up workflows that involve network access of emulated EC2 instances. (🌟 pro)
- EC2 now provides [Ubuntu 22.04 and Amazon Linux 2023 AMIs](https://docs.localstack.cloud/user-guide/aws/elastic-compute-cloud/#instances-and-amis) by default. (🌟 pro)
- MWAA now supports Airflow 2.6.3 and 2.7.2 and comes with improved ARM64 compatibility. (🌟 pro)
- Significant improvements to multi-accounts and multi-region setup compatibility.
- RDS now comes with built-in support for the [PostGIS extension](https://postgis.net/documentation/getting_started/). (🌟 pro)

LocalStack Features

- New Resource Browsers for the following AWS services are available on LocalStack Web Application:
- ACM
- Amplify
- AppConfig
- Cognito Identity
- DocumentDB
- EKS
- MQ
- MWAA
- QLDB
- Transcribe
- SNS Resource Browser now allows you to publish messages from the LocalStack Web Application.

Deprecations

- MWAA: Airflow versions v1.10.12, v2.0.2, v2.2.2 have [reached end-of-support](https://docs.aws.amazon.com/mwaa/latest/userguide/airflow-versions.html#airflow-versions-official) and will be removed in the next major release of LocalStack
- EC2: LocalStack will no longer provide the Ubuntu 20.04 Docker AMI by default from the next major release.
- RDS: Postgres 10 is deprecated and will not be available from the next major release.
- Cloud Pods: Due to a critical security update, some Cloud Pods may break with this release. It is advisable to re-create the Cloud Pods with the latest version of LocalStack.

What's Changed
Exciting New Features 🎉
* Bump moto-ext to 5.0.0.post1 by alexrashed in https://github.com/localstack/localstack/pull/10112
* Add AWS::EC2::KeyPair by pinzon in https://github.com/localstack/localstack/pull/10100
* Fix: Firehose: Multiple firehose delivery streams not receiving messages from kinesis event stream by maxhoheiser in https://github.com/localstack/localstack/pull/10155
* pin botocore with ASF API updates, add ASF API forward compatibility by alexrashed in https://github.com/localstack/localstack/pull/10183
* remove pins in setup.cfg, add .python-version by alexrashed in https://github.com/localstack/localstack/pull/10195
* Feature: Events: Add input transformers by maxhoheiser in https://github.com/localstack/localstack/pull/10159
* Refactor: Kinesis: Clean-up test fixtures by maxhoheiser in https://github.com/localstack/localstack/pull/10058
* enable Fn::Transform to use CFn macros by pinzon in https://github.com/localstack/localstack/pull/9776
* add opensearch 2.11 by HarshCasper in https://github.com/localstack/localstack/pull/9935
* Change AWS_EXECUTION_ENV set in the lambda init binary by dfangl in https://github.com/localstack/localstack/pull/10212
* CFn: improve error reporting by simonrw in https://github.com/localstack/localstack/pull/10255
* upgrade plux to 1.7 by thrau in https://github.com/localstack/localstack/pull/10266
* update S3 pre-signed credentials logic by bentsku in https://github.com/localstack/localstack/pull/10265
* HTTP IntegrationSubtype support for Kinesis-PutRecord by calvernaz in https://github.com/localstack/localstack/pull/10288
* add support to websockets and sns backend by calvernaz in https://github.com/localstack/localstack/pull/10140
* add option to serve gateway through werkzeug by thrau in https://github.com/localstack/localstack/pull/10171
* Feature: Scenario Tests: Firehose central scenario test by maxhoheiser in https://github.com/localstack/localstack/pull/10243
Other Changes
* Fix prebuilding for lambda functions by dominikschubert in https://github.com/localstack/localstack/pull/9929
* Update README with 3.1.0 version by simonrw in https://github.com/localstack/localstack/pull/10121
* upgrade rolo to 0.3.x by thrau in https://github.com/localstack/localstack/pull/10129
* [SFN] Support for ReverseOrder in GetExecutionHistory Requests by MEPalma in https://github.com/localstack/localstack/pull/10131
* Update CODEOWNERS by localstack-bot in https://github.com/localstack/localstack/pull/10132
* add script to track validations instead of snapshots by baermat in https://github.com/localstack/localstack/pull/10064
* add dynamic SQS endpoint strategy to build SQS queues from called host by thrau in https://github.com/localstack/localstack/pull/10135
* Rework internal lambda routes to avoid router modifications for every spawned environment by dfangl in https://github.com/localstack/localstack/pull/10133
* Enhance implementation of is_comma_delimited_list to fix --services in pods CLI by whummer in https://github.com/localstack/localstack/pull/10142
* add tests for fix to SNS empty filter policy by bentsku in https://github.com/localstack/localstack/pull/10125
* hot fix for ec2 key pair deployment test by pinzon in https://github.com/localstack/localstack/pull/10148
* CFn: improve error message for invalid ref by simonrw in https://github.com/localstack/localstack/pull/10149
* Enhance parity for DynamoDB to Kinesis stream integration by whummer in https://github.com/localstack/localstack/pull/10143
* Fix scenario tests failing with non-default region by viren-nadkarni in https://github.com/localstack/localstack/pull/9149
* fix Kinesis rejection of log level by bentsku in https://github.com/localstack/localstack/pull/10158
* cloudwatch: fix functionality of metrics for multi-accounts and region by sannya-singal in https://github.com/localstack/localstack/pull/9945
* [SFN] SNS Optimised Integration: Automatic Stringification of Message Arguments by MEPalma in https://github.com/localstack/localstack/pull/10165
* fix dynamodb router rule removal by thrau in https://github.com/localstack/localstack/pull/10172
* Fix bootstrap tests failing in non-default region by viren-nadkarni in https://github.com/localstack/localstack/pull/10152
* skip flaky dynamodb streams test by alexrashed in https://github.com/localstack/localstack/pull/10180
* DynamoDB: Fix startup in non-default account ID/region by viren-nadkarni in https://github.com/localstack/localstack/pull/10157
* fix custom status code for lambda URLs by thrau in https://github.com/localstack/localstack/pull/10170
* Update lambda init binary by dfangl in https://github.com/localstack/localstack/pull/10163
* fix disk space issues in GitHub workflow by alexrashed in https://github.com/localstack/localstack/pull/10186
* Fix/multi account kinesis by macnev2013 in https://github.com/localstack/localstack/pull/10188
* [SFN]: Support for CausePath and ErrorPath by MEPalma in https://github.com/localstack/localstack/pull/10130
* add APIGW RequestParametersResolver support for context var by bentsku in https://github.com/localstack/localstack/pull/10176
* stepfunction: fix sns fifo message attributes by sannya-singal in https://github.com/localstack/localstack/pull/10201
* APIGW: add more debug log when lambda proxy response format is wrong by bentsku in https://github.com/localstack/localstack/pull/10206
* Feature: Lambda: Add aws validated test for two lambdas subscribing to same kinensis event stream by maxhoheiser in https://github.com/localstack/localstack/pull/10166
* Stop DNS server on shutdown by simonrw in https://github.com/localstack/localstack/pull/10161
* [SFN] Enhanced Support for Comments Declarations by MEPalma in https://github.com/localstack/localstack/pull/10211
* add automated Python requirements update by alexrashed in https://github.com/localstack/localstack/pull/10219
* fixed multi account support for logs by macnev2013 in https://github.com/localstack/localstack/pull/10202
* Restore DNS settings in container after dns server shuts down by dfangl in https://github.com/localstack/localstack/pull/10221
* Extract snapshot lib by dominikschubert in https://github.com/localstack/localstack/pull/10164
* Add pipes service principal by joe4dev in https://github.com/localstack/localstack/pull/10224
* Simplify Lambda payload parsing by joe4dev in https://github.com/localstack/localstack/pull/10210
* Fix Lambda function alias name checks by dominikschubert in https://github.com/localstack/localstack/pull/10227
* fine-tune workflow triggers by alexrashed in https://github.com/localstack/localstack/pull/10194
* Sqs fix message groups visibility by baermat in https://github.com/localstack/localstack/pull/10223
* Fix lambda perftests for number of functions and versions by joe4dev in https://github.com/localstack/localstack/pull/10209
* Add Lambda tests for large response handling by dominikschubert in https://github.com/localstack/localstack/pull/10229
* Handler chain must not use test variables by viren-nadkarni in https://github.com/localstack/localstack/pull/10230
* Implement dynamodb TimeToLive in cloudformation by giograno in https://github.com/localstack/localstack/pull/10238
* Load new resource providers by default if available and fall back to legacy models by dominikschubert in https://github.com/localstack/localstack/pull/10242
* Add CFn provider util to convert into lower camel case by dominikschubert in https://github.com/localstack/localstack/pull/10245
* Fix override of legacy resource providers over new community ones for certain resources by dominikschubert in https://github.com/localstack/localstack/pull/10249
* Lambda: Fix test_cross_account_access flakes by viren-nadkarni in https://github.com/localstack/localstack/pull/10240
* fix S3 image rate limiting with docker login by bentsku in https://github.com/localstack/localstack/pull/10244
* Add support for composite physical resource ID quirks by dominikschubert in https://github.com/localstack/localstack/pull/10250
* enhance download progress logging by alexrashed in https://github.com/localstack/localstack/pull/10241
* Update boto3 stubs and types for our client factory by Morijarti in https://github.com/localstack/localstack/pull/9796
* Use fixtures for test credentials and region name by viren-nadkarni in https://github.com/localstack/localstack/pull/10207
* events: add account_id while creating client in sending events to target by sannya-singal in https://github.com/localstack/localstack/pull/9784
* CFn: enable AWS::ECS::Service PhysicalResourceId quirk by Morijarti in https://github.com/localstack/localstack/pull/10124
* Fix Lambda handler update for UpdateFunctionConfiguration by joe4dev in https://github.com/localstack/localstack/pull/10246
* Fix architecture update for Lambda function by joe4dev in https://github.com/localstack/localstack/pull/10263
* SNS: Fix test assertions to query to correct account and region by viren-nadkarni in https://github.com/localstack/localstack/pull/10261
* Update CODEOWNERS by localstack-bot in https://github.com/localstack/localstack/pull/10271
* [SFN] Support for JsonPath Regexes by MEPalma in https://github.com/localstack/localstack/pull/9942
* [SFN] Enhance Automatic Serialisation of AWS-SDK Task Parameters by MEPalma in https://github.com/localstack/localstack/pull/10174
* add test for SQS FIFO dedup behaviour in high throughput mode by baermat in https://github.com/localstack/localstack/pull/10274
* Add trailing newline for linter compliance by joe4dev in https://github.com/localstack/localstack/pull/10278
* Reduce requests necessary for lambda log publishing to cloudwatch logs by dfangl in https://github.com/localstack/localstack/pull/10234
* Add support for 'invoke-mode' for lambda function-url-config by steffyP in https://github.com/localstack/localstack/pull/10277
* Bump moto-ext to 5.0.2.post1 by viren-nadkarni in https://github.com/localstack/localstack/pull/10286
* fix pro auth token check by alexrashed in https://github.com/localstack/localstack/pull/10293
* Revert "Reduce requests necessary for lambda log publishing to cloudwatch logs" by dfangl in https://github.com/localstack/localstack/pull/10294
* Save session tags when assuming a role by dfangl in https://github.com/localstack/localstack/pull/10283
* Fix issues in CFn resources and filter notfound exceptions for delete operations by dominikschubert in https://github.com/localstack/localstack/pull/10273
* Change schedule for dependency pin upgrade by silv-io in https://github.com/localstack/localstack/pull/10298
* Add support for CFn dot attributes that conflict with schema by dominikschubert in https://github.com/localstack/localstack/pull/10297
* Add custom physical resource ID for AWS::RDS::DBProxyTargetGroup by Morijarti in https://github.com/localstack/localstack/pull/9905
* [SFN] Support for Retriers Interval Modifiers by MEPalma in https://github.com/localstack/localstack/pull/10267
* Add tracking of entire workflow scopes to Tinybird by silv-io in https://github.com/localstack/localstack/pull/10282
* Remove implicit credentials for Boto to fall back on by viren-nadkarni in https://github.com/localstack/localstack/pull/10272
* Allow extension hooks to modify non-Boto env vars by viren-nadkarni in https://github.com/localstack/localstack/pull/10306
* update validation of Lambda AWS Proxy format by bentsku in https://github.com/localstack/localstack/pull/10312
* Update CODEOWNERS by localstack-bot in https://github.com/localstack/localstack/pull/10319
* fix pre-signed POST when file is passed as regular form field by bentsku in https://github.com/localstack/localstack/pull/10314
* Add fallback for deletes in updates and fix update for AWS::Lambda::Permission by dominikschubert in https://github.com/localstack/localstack/pull/10320
* Bump pinned postgres version in CI to 14.11 by dominikschubert in https://github.com/localstack/localstack/pull/10334
* added DOCKER.md for docker hub by tkrsh in https://github.com/localstack/localstack/pull/10208
* Validate import_certificate test by simonrw in https://github.com/localstack/localstack/pull/10303
* Fix delete issues in resource providers for "AWS::ApiGateway::UsagePlanKey" and "AWS::Kinesis::StreamConsumer" by dominikschubert in https://github.com/localstack/localstack/pull/10335
* Make keys_pascalcase_to_lower_camelcase recursive by dominikschubert in https://github.com/localstack/localstack/pull/10337
* fix API Gateway route matching order by bentsku in https://github.com/localstack/localstack/pull/10317
* Add SQS high-throughput deduplication behaviour by baermat in https://github.com/localstack/localstack/pull/10324

New Contributors
* tkrsh made their first contribution in https://github.com/localstack/localstack/pull/10208

**Full Changelog**: https://github.com/localstack/localstack/compare/v3.1.0...v3.2.0

<!-- Release notes generated using configuration in .github/release.yml at v3.1.0 -->

Summary

LocalStack 3.1 is here with exciting new features and enhancements. It introduces initial support for new providers: EventBridge Pipes, MemoryDB, Account, WAFv2, Identity Store, AMB, ACM PCA, as well as new features for existing services: the Instance Metadata Service (IMDS). Additionally, it offers improvements in DynamoDB, SQS, CloudWatch, RDS, ElastiCache and Lambda. The release also includes enhancements in Cloud Pods, Resource Browsers, and CI Keys Usage inspection.

New Features and Services

- Initial support for a new EventBridge Pipes provider to create Pipes with SQS queues and Kinesis streams as source and target. You can filter events using EventBridge event patterns and enrich events using Lambda. (🌟 pro)
- Initial support for a new MemoryDB provider to create and manage MemoryDB clusters locally, either in the LocalStack container itself or in separate containers for each cluster node. (🌟 pro)
- ElastiCache now supports creating Redis cache nodes and clusters as individual Docker containers, similar to MemoryDB. (🌟 pro)
- Initial support for a new Account provider, supporting basic CRUD operations surrounding AWS account management. (🌟 pro)
- Initial support for a new WAFv2 provider, supporting basic CRUD operations surrounding AWS Web Application Provider. (🌟 pro)
- Initial support for a new ACM PCA provider, supporting basic CRUD operations surrounding AWS Private Certificate Authority. (🌟 pro)
- Initial support for the Instance Metadata Service (IMDS) that exposes an endpoint inside every EC2 instance at [`http://169.254.169.254/`](http://169.254.169.254/). (🌟 pro)
- Initial support for the Identity Store provider, supporting basic CRUD operations surrounding AWS IAM Identity Center. (🌟 pro)
- A new LocalStack-native CloudWatch provider is available behind a feature flag: `PROVIDER_OVERRIDE_CLOUDWATCH=v2`, which includes a lot of parity fixes and is designed to be thread safe.
- Initial support for a new Managed Blockchain provider, supporting basic CRUD operations surrounding Amazon Managed Blockchain. (🌟 pro)

Enhancements

- DynamoDB now supports [Time to Live (TTL)](https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/TTL.html) which allows you to define a per-item expiration timestamp that indicates when an item is no longer needed, and delete it automatically.
- SQS now supports dead-letter queue re-drive emulation through `StartMessageMoveTask`, `CancelMessageMoveTask`, and `ListMessageMoveTasks` API operations.
- CloudWatch now supports Lambda targets for alarm actions on LocalStack.
- RDS now supports providing admin permission to the master users on RDS for MySQL and MariaDB engines. (🌟 pro)
- Lambda performance improvements for asynchronous invocations along with reduction in `ReadTimeoutError`occurrences during high load on LocalStack.

LocalStack Features

- Cloud Pods `save` and `load` commands now show a progress status on the CLI. (🌟 pro)
- New Resource Browsers for the following AWS services are available on LocalStack Web Application: OpenSearch, CloudFront, and Application Auto Scaling. In addition, new runtimes have been added to the Lambda Resource Browser. (🌟 pro)
- Users can now inspect CI Keys Usage on the LocalStack Web Application. (🌟 pro)

Deprecations

- `DNS_LOCAL_NAME_PATTERNS` is removed in favor of `DNS_NAME_PATTERNS_TO_RESOLVE_UPSTREAM` to list domain names that should not be resolved to the LocalStack container, but forwarded to the upstream resolver.


What's Changed
Exciting New Features 🎉
* Add option to disable AWS_ENDPOINT_URL by joe4dev in https://github.com/localstack/localstack/pull/9792
* Introduce DNS_NAME_PATTERNS_TO_RESOLVE_UPSTREAM config by simonrw in https://github.com/localstack/localstack/pull/9692
* add support for AWS::DynamoDB::GlobalTable resource type by pinzon in https://github.com/localstack/localstack/pull/9790
* Simplify the official docker-compose.yml by joe4dev in https://github.com/localstack/localstack/pull/9822
* Add flag to disable kinesis-mock persistence by dfangl in https://github.com/localstack/localstack/pull/9871
* Transcribe: Add support for transcribing video files by viren-nadkarni in https://github.com/localstack/localstack/pull/9898
* introduce request finalizers into handler chain by thrau in https://github.com/localstack/localstack/pull/9194
* Test lambda performance and mitigate async invoke timeout error (9917) by joe4dev in https://github.com/localstack/localstack/pull/9917
* add cli option to restart localstack container by HarshCasper in https://github.com/localstack/localstack/pull/9904
* Updates deduplication ID and group ID max length to 128 by nishadcptn in https://github.com/localstack/localstack/pull/9923
* add lambda alarm action for cloudwatch by steffyP in https://github.com/localstack/localstack/pull/9985
* Test lambda performance and mitigate async invoke timeout error v2 by joe4dev in https://github.com/localstack/localstack/pull/9972
* fix lambda create event source mapping duplicates by thrau in https://github.com/localstack/localstack/pull/9996
* fix sqs multi-protocol handling and upgrade botocore by alexrashed in https://github.com/localstack/localstack/pull/9710
* add SNS signing of messages by bentsku in https://github.com/localstack/localstack/pull/9997
* add extension mechanism for exceptions by thrau in https://github.com/localstack/localstack/pull/10019
* Add config option to control maximum gateway worker thread count by dfangl in https://github.com/localstack/localstack/pull/10016
* fix support calling sqs from api ws gw on disconnect endpoint by calvernaz in https://github.com/localstack/localstack/pull/10008
* implement apigw request validation for parameters (header/path/qs) by bentsku in https://github.com/localstack/localstack/pull/10036
* refactor http router for better werkzeug compatibility by thrau in https://github.com/localstack/localstack/pull/10011
* move http framework code to rolo and only keep references by thrau in https://github.com/localstack/localstack/pull/10061
* Make the internal sqs implementation of lambda events the default by dfangl in https://github.com/localstack/localstack/pull/10062
* Add Cloudwatch v2 Provider by pinzon in https://github.com/localstack/localstack/pull/9347
* move gateway and handler chain framework to rolo by thrau in https://github.com/localstack/localstack/pull/10092
Other Changes
* add APIGW PutIntegration IntegrationType validation by bentsku in https://github.com/localstack/localstack/pull/9763
* Enable test for Fn::GetAZs and extend feature by pinzon in https://github.com/localstack/localstack/pull/9740
* fix kms key creation for s3 encryption by sannya-singal in https://github.com/localstack/localstack/pull/9751
* Remove thread-local region, access key and account ID by viren-nadkarni in https://github.com/localstack/localstack/pull/9750
* added util function for time by macnev2013 in https://github.com/localstack/localstack/pull/9736
* Enable AppSync cloudformation resources by simonrw in https://github.com/localstack/localstack/pull/9726
* Add list to dictionary transformation function in provider_utils For CFn by Morijarti in https://github.com/localstack/localstack/pull/9786
* Update Lambda runtime test skip condition by simonrw in https://github.com/localstack/localstack/pull/9760
* Fix alias resource records & add missing id in AWS::Route53::RecordSet by dominikschubert in https://github.com/localstack/localstack/pull/9788
* Add option to capture raw snapshots when running tests by dominikschubert in https://github.com/localstack/localstack/pull/9775
* [SFN] Fix string lexing in Intrinsic Function arguments by MEPalma in https://github.com/localstack/localstack/pull/9783
* Support creation of CloudFormation stacks with the same name after deletion by dominikschubert in https://github.com/localstack/localstack/pull/9748
* Fix StepFunctions execution date formatting by dominikschubert in https://github.com/localstack/localstack/pull/9702
* Fix missing "Pulling container image" message from CLI startup by simonrw in https://github.com/localstack/localstack/pull/9778
* add missing DeadLetterConfig parameter by baermat in https://github.com/localstack/localstack/pull/9773
* fix recursive types when generating TypedDicts by alexrashed in https://github.com/localstack/localstack/pull/9797
* fixed account id for firehose integration by macnev2013 in https://github.com/localstack/localstack/pull/9785
* fix AWS::SQS::Queue update missing QueueArn and QueueUrl by bentsku in https://github.com/localstack/localstack/pull/9744
* Cfn: Fix boto client not using credentials for Lambda PublishVersion by viren-nadkarni in https://github.com/localstack/localstack/pull/9787
* fix: fix failing dashboard lifecycle test for multi-account and region by sannya-singal in https://github.com/localstack/localstack/pull/9799
* [SFN] Enhancements to States I/O, Support for null InputPath and OutputPath by MEPalma in https://github.com/localstack/localstack/pull/9801
* Improve lambda multiruntime tests by joe4dev in https://github.com/localstack/localstack/pull/9798
* Add support for conditions on CFn stack outputs by dominikschubert in https://github.com/localstack/localstack/pull/9814
* add cross-account for CopyObject by bentsku in https://github.com/localstack/localstack/pull/9806
* fix: handle BucketAlreadyOwnedByYou exception when uploading lambda in scenario test cases by sannya-singal in https://github.com/localstack/localstack/pull/9805
* CFn: fix AWS::Events::Rule ref/id/name attributes by simonrw in https://github.com/localstack/localstack/pull/9789
* Bump Postgresql CI dependency by viren-nadkarni in https://github.com/localstack/localstack/pull/9818
* Implemented support for AWS::Lambda:* Resource Provider for CloudFormation by Morijarti in https://github.com/localstack/localstack/pull/9508
* Implemented AWS::CDK::Metadata resource provider by Morijarti in https://github.com/localstack/localstack/pull/9520
* fix s3 presign tests for multi account support by macnev2013 in https://github.com/localstack/localstack/pull/9816
* Fix AWS parity for SQS list queues with empty response by joe4dev in https://github.com/localstack/localstack/pull/9828
* Prevent error message being shown with entrypoints command by simonrw in https://github.com/localstack/localstack/pull/9827
* Fix: lookup more specific DNS names directly by simonrw in https://github.com/localstack/localstack/pull/9815
* APIGW: Fix tests to run with non-default account ID by viren-nadkarni in https://github.com/localstack/localstack/pull/9690
* Install websocket-client as it is no longer included with docker client by simonrw in https://github.com/localstack/localstack/pull/9841
* Add formatting-aware timestamp replacement via new TimestampTransformer by dominikschubert in https://github.com/localstack/localstack/pull/9772
* Skip comment for entrypoints line by simonrw in https://github.com/localstack/localstack/pull/9838
* Fix lambda function name validation for CreateFunction by joe4dev in https://github.com/localstack/localstack/pull/9825
* Fix serialization of content in raw snapshots by dominikschubert in https://github.com/localstack/localstack/pull/9820
* remove outdated documentation and improve the README files by HarshCasper in https://github.com/localstack/localstack/pull/9850
* Fix SQS CFn updates with no change by simonrw in https://github.com/localstack/localstack/pull/9831
* fix s3 key handling with trailing slash by bentsku in https://github.com/localstack/localstack/pull/9856
* fix: serverless failing multi-account/region tests by sannya-singal in https://github.com/localstack/localstack/pull/9840
* pin docker dependency to <7.0.0 by dominikschubert in https://github.com/localstack/localstack/pull/9864
* Updated Cloudformationn Schema to latest version by Morijarti in https://github.com/localstack/localstack/pull/9865
* fix S3 lifecycle tags filter by bentsku in https://github.com/localstack/localstack/pull/9859
* Allow merging of config profiles by dfangl in https://github.com/localstack/localstack/pull/9873
* Add support for partial ARNs for EventSourceMappings and fix AWS::Lambda::Version state check by dominikschubert in https://github.com/localstack/localstack/pull/9879
* CloudWatch: Use SNS client with same region as topic by viren-nadkarni in https://github.com/localstack/localstack/pull/9878
* Fix: Route53 populating VPC fields by simonrw in https://github.com/localstack/localstack/pull/9885
* fix APIGW import integration method for AWS integration type by bentsku in https://github.com/localstack/localstack/pull/9810
* Bump moto-ext to 4.2.11.post1 by viren-nadkarni in https://github.com/localstack/localstack/pull/9852
* Update CODEOWNERS by localstack-bot in https://github.com/localstack/localstack/pull/9835
* remove code in state locator by giograno in https://github.com/localstack/localstack/pull/9894
* Update dynamodb snapshot to unblock pipeline by dominikschubert in https://github.com/localstack/localstack/pull/9910
* Bump Kinesis Mock to 0.4.5 by etspaceman in https://github.com/localstack/localstack/pull/9906
* fix S3 UploadPart logic when cancelling/error a request by bentsku in https://github.com/localstack/localstack/pull/9901
* Allow kinesis get_records shard iterator to have surrounding quotes by dfangl in https://github.com/localstack/localstack/pull/9884
* Added missing type conversion for CFn update of Lambda::Function MemorySize to int by Morijarti in https://github.com/localstack/localstack/pull/9903
* add S3 object key validation by bentsku in https://github.com/localstack/localstack/pull/9875
* Fix Lambda Kinesis event filtering by danielpoonwj in https://github.com/localstack/localstack/pull/6826
* Refine get in touch readme by joe4dev in https://github.com/localstack/localstack/pull/9922
* [SFN] Fix Parallel State Output Ordering by MEPalma in https://github.com/localstack/localstack/pull/9889
* [SFN] Support for Optional ProcessorConfig Declarations by MEPalma in https://github.com/localstack/localstack/pull/9888
* Remove error message if environment does not exist by dfangl in https://github.com/localstack/localstack/pull/9913
* Track date of last passed validation run of tests targeting AWS by dominikschubert in https://github.com/localstack/localstack/pull/9927
* fix CFN RequestValidator parameters being optional by bentsku in https://github.com/localstack/localstack/pull/9915
* fix S3 service name parsing consuming the stream by bentsku in https://github.com/localstack/localstack/pull/9874
* Fix: ACM: Additional domains missing from subject alternative names summaries by maxhoheiser in https://github.com/localstack/localstack/pull/9897
* Fix: EventBus: match null value for anything-but rule by maxhoheiser in https://github.com/localstack/localstack/pull/9925
* Add initial validation files for recorded snapshots by dominikschubert in https://github.com/localstack/localstack/pull/9928
* Add support for AWS::Cognito::* in CloudFormation by Morijarti in https://github.com/localstack/localstack/pull/9855
* Add AWS::Athena::* Resource Providers for CFn by Morijarti in https://github.com/localstack/localstack/pull/9779
* Add AppConfig resource providers to CFn by Morijarti in https://github.com/localstack/localstack/pull/9774
* [SFN] Enhanced Support for Exception Handling in Parallel States by MEPalma in https://github.com/localstack/localstack/pull/9891
* Update CODEOWNERS by localstack-bot in https://github.com/localstack/localstack/pull/9938
* Revert recent changes to async lambda invoke (9917) by dominikschubert in https://github.com/localstack/localstack/pull/9944
* Enable migrated SES resource providers by dominikschubert in https://github.com/localstack/localstack/pull/9950
* Add new client types to TypedServiceClientFactory by dominikschubert in https://github.com/localstack/localstack/pull/9953
* Cfn: Fix nested stack name generation by viren-nadkarni in https://github.com/localstack/localstack/pull/9926
* Fix: EventBus: Exists prefix not considered for rule matching by maxhoheiser in https://github.com/localstack/localstack/pull/9931
* Fix secret rotation in secretsmanager by lakkeger in https://github.com/localstack/localstack/pull/9862
* fix S3 CORS headers casing matching by bentsku in https://github.com/localstack/localstack/pull/9973
* add SQS message retention period functionality by thrau in https://github.com/localstack/localstack/pull/9956
* fix sqs message group visibility when sending messages by thrau in https://github.com/localstack/localstack/pull/9975
* use batches to report SQS metrics for approximate query metrics by steffyP in https://github.com/localstack/localstack/pull/9886
* add subrange operation for ports by thrau in https://github.com/localstack/localstack/pull/9965
* add exception module to event source mappings by thrau in https://github.com/localstack/localstack/pull/9964
* Add integration test for SQS FIFO event source order/parallelism by dominikschubert in https://github.com/localstack/localstack/pull/7037
* Add link-local address and init args to Docker client API by viren-nadkarni in https://github.com/localstack/localstack/pull/9900
* fix S3 missing XML namespace by bentsku in https://github.com/localstack/localstack/pull/9983
* fix cloudwatch alarm evaluation for SampleCount by steffyP in https://github.com/localstack/localstack/pull/9978
* fix snapshot match order by steffyP in https://github.com/localstack/localstack/pull/9993
* fix SQS send batch message validation for message size by thrau in https://github.com/localstack/localstack/pull/9981
* fix CopySource unquoting of special + char by bentsku in https://github.com/localstack/localstack/pull/9992
* add SQS message move task feature by thrau in https://github.com/localstack/localstack/pull/9988
* snapshot test for return values on condition check failure by giograno in https://github.com/localstack/localstack/pull/9984
* improve S3 aws-chunked detection by bentsku in https://github.com/localstack/localstack/pull/9999
* Add events method to docker clients by simonrw in https://github.com/localstack/localstack/pull/9932
* fix flaky sns unit test by thrau in https://github.com/localstack/localstack/pull/10012
* add OpenSearch analysis-kuromoji plugin by alexrashed in https://github.com/localstack/localstack/pull/10001
* [SFN] Support for Version Declarations by MEPalma in https://github.com/localstack/localstack/pull/9948
* Revert "Add events method to docker clients (9932)" by dfangl in https://github.com/localstack/localstack/pull/10025
* Bump moto-ext to 5.0.0alpha1.post1 by viren-nadkarni in https://github.com/localstack/localstack/pull/10017
* Add AWS::ApiGateway and AWS::Add AWS::ApiGatewayV2 resources by Morijarti in https://github.com/localstack/localstack/pull/9629
* refactor Poller.handle_message and extract process_event_retry by thrau in https://github.com/localstack/localstack/pull/10043
* [SFN] Implicit Reductions To and From botocore Types by MEPalma in https://github.com/localstack/localstack/pull/9920
* allow headers to be set from integration definition for HTTP integrat… by jimmydurkin in https://github.com/localstack/localstack/pull/10035
* fix CLI issue with outdated click version by alexrashed in https://github.com/localstack/localstack/pull/10029
* Add new internalized sqs queue for lambda events by dfangl in https://github.com/localstack/localstack/pull/10045
* feat: DynamoDB TTL by giograno in https://github.com/localstack/localstack/pull/10041
* Dynamodb: Fix disable SSESpecification with UpdateTable by viren-nadkarni in https://github.com/localstack/localstack/pull/10040
* Support dynamic port on Lambda remote debugging by yamadayutaka in https://github.com/localstack/localstack/pull/9420
* fix source ip value for the lambda event request by calvernaz in https://github.com/localstack/localstack/pull/10038
* Fix: ACM: Describe DomainValidationOptions for subject alternative names duplicated with additional suffix by maxhoheiser in https://github.com/localstack/localstack/pull/10027
* patch HTTPServer fixture to spawn daemon thread by bentsku in https://github.com/localstack/localstack/pull/10052
* refactor EventSourceAsfAdapter for easier instrumentation by thrau in https://github.com/localstack/localstack/pull/10053
* Skip snapshot verification for CodeSha256 in lambda API test by dominikschubert in https://github.com/localstack/localstack/pull/10055
* Make lambda sqs event source mapping interval configurable by dfangl in https://github.com/localstack/localstack/pull/10051
* update the year in the license section by HarshCasper in https://github.com/localstack/localstack/pull/10050
* Implement resource provider for AWS::Lambda::Function by dominikschubert in https://github.com/localstack/localstack/pull/9321
* fix return value for AWS::Cognito::UserPoolClient by giograno in https://github.com/localstack/localstack/pull/10060
* supports enabling S3 Object Lock on existing buckets by bentsku in https://github.com/localstack/localstack/pull/10071
* add support for ObjectLock for CFN S3 Bucket by bentsku in https://github.com/localstack/localstack/pull/10070
* fix S3 v-host unit tests after rolo migration by bentsku in https://github.com/localstack/localstack/pull/10099
* use request parameter resolvers by calvernaz in https://github.com/localstack/localstack/pull/10049
* Pin cryptography package to below 42.0.0 by silv-io in https://github.com/localstack/localstack/pull/10105
* correctly execute host and container configuration hooks in dev.run by thrau in https://github.com/localstack/localstack/pull/10108
* Dev mode: return correctly from raw mode by simonrw in https://github.com/localstack/localstack/pull/10111
* Register EventBridge Pipes CloudFormation resource provider by joe4dev in https://github.com/localstack/localstack/pull/10110

New Contributors
* danielpoonwj made their first contribution in https://github.com/localstack/localstack/pull/6826
* maxhoheiser made their first contribution in https://github.com/localstack/localstack/pull/9897
* nishadcptn made their first contribution in https://github.com/localstack/localstack/pull/9923
* jimmydurkin made their first contribution in https://github.com/localstack/localstack/pull/10035
* yamadayutaka made their first contribution in https://github.com/localstack/localstack/pull/9420

**Full Changelog**: https://github.com/localstack/localstack/compare/v3.0.2...v3.1.0

What's Changed
* fix extensions dev mode in binary builds by alexrashed in https://github.com/localstack/localstack-cli/pull/21

**Full Changelog**: https://github.com/localstack/localstack-cli/compare/v3.0.2...v3.0.2.post0

In this patch release we've fixed a major issue in the `localstack` CLI. Since the last release the CLI was missing advanced commands like `auth` and `pod`, which should now work again.

What's Changed
* fix get_raw_path with double slash prefix path for legacy v-host S3 by bentsku in https://github.com/localstack/localstack/pull/9725
* CFn: render ext providers with correct plugin namespace by simonrw in https://github.com/localstack/localstack/pull/9728
* [SFN] Support for CF Definition fields by MEPalma in https://github.com/localstack/localstack/pull/9677
* [SFN] Enhancements to V2 Interpreter by MEPalma in https://github.com/localstack/localstack/pull/9721
* [SFN] Fix optimised integrations clients leading to timeouts and retries by MEPalma in https://github.com/localstack/localstack/pull/9732
* [SFN] Context Object arguments in Intrinsic Functions by MEPalma in https://github.com/localstack/localstack/pull/9733
* fix cloudwatch resource providers by pinzon in https://github.com/localstack/localstack/pull/9739
* s3: add SourceBucketLocation for CrossLocationLoggingProhibitions exception by sannya-singal in https://github.com/localstack/localstack/pull/9737
* Remove HEADER_LOCALSTACK_ACCOUNT_ID by viren-nadkarni in https://github.com/localstack/localstack/pull/9724
* Remove last uses of get_aws_account_id() and aws_stack.get_region() by viren-nadkarni in https://github.com/localstack/localstack/pull/9641
* Remove localstack client dependency by simonrw in https://github.com/localstack/localstack/pull/9368
* [SFN] Enhancements for Intrinsic Function StringSplit by MEPalma in https://github.com/localstack/localstack/pull/9749
* fix AWS::SNS::Topic canonicalizing bool to str for Attributes by bentsku in https://github.com/localstack/localstack/pull/9743
* create s3 image and pipeline by bentsku in https://github.com/localstack/localstack/pull/9712
* s3: fix test_put_bucket_logging_wrong_target for multi-account and region by sannya-singal in https://github.com/localstack/localstack/pull/9713
* Fix Lambda CloudWatch metric recording upon invocation error by joe4dev in https://github.com/localstack/localstack/pull/9752
* Test lambda provisioned concurrency scheduling by joe4dev in https://github.com/localstack/localstack/pull/9762
* Fix for double-slash uri request by calvernaz in https://github.com/localstack/localstack/pull/9723
* fix type hints incompatible with python < 3.10 in aws_stack by viren-nadkarni in https://github.com/localstack/localstack/pull/9765
* pin global awscli install in Dockerfile by bentsku in https://github.com/localstack/localstack/pull/9767


**Full Changelog**: https://github.com/localstack/localstack/compare/v3.0.1...v3.0.2

<!-- Release notes generated using configuration in .github/release.yml at v3.0.1 -->

What's Changed
* [minor] skip mounting binary pip dependencies in dev container by whummer in https://github.com/localstack/localstack/pull/9585
* unpin opensearch-py by alexrashed in https://github.com/localstack/localstack/pull/9665
* switch to shared pr label enforcers, add bugfix only action by alexrashed in https://github.com/localstack/localstack/pull/9673
* SQS: Rework is_sqs_queue_url() utility by viren-nadkarni in https://github.com/localstack/localstack/pull/9638
* fix s3 skip presign for missing SignedHeaders and fix query string param to headers by bentsku in https://github.com/localstack/localstack/pull/9676
* Fix broken multi-account/multi-region functionality by viren-nadkarni in https://github.com/localstack/localstack/pull/9541
* skip emitting events in SSM if not enabled by bentsku in https://github.com/localstack/localstack/pull/9682
* add cw tests for lambda Invocations and Errors metrics by steffyP in https://github.com/localstack/localstack/pull/9653
* fix get_object_tagging should work on versioned buckets without providing an explicit VersionId by matt-mercer in https://github.com/localstack/localstack/pull/9684
* Rename ARN builders for consistency by viren-nadkarni in https://github.com/localstack/localstack/pull/9618
* Fix execution storage for new stepfunctions provider by dominikschubert in https://github.com/localstack/localstack/pull/9696
* Fix int exception for API GW by lakkeger in https://github.com/localstack/localstack/pull/9672
* Bump moto-ext to 4.2.9.post2 by viren-nadkarni in https://github.com/localstack/localstack/pull/9624
* unpin botocore, update minimum version by alexrashed in https://github.com/localstack/localstack/pull/9667
* Refactor kinesis connector by dfangl in https://github.com/localstack/localstack/pull/9644
* corrects status for instance profile resource provider by pinzon in https://github.com/localstack/localstack/pull/9474
* remove sqs-query from health endpoint by alexrashed in https://github.com/localstack/localstack/pull/9709
* avoid botocore 1.32.6 by alexrashed in https://github.com/localstack/localstack/pull/9714
* apigateway: add IAM role to apigateway integration with services by sannya-singal in https://github.com/localstack/localstack/pull/9639
* fix transfer.ListTagsForResource collect not implemented call by dfangl in https://github.com/localstack/localstack/pull/9716
* Add new lambda runtimes and more parity fixes by joe4dev in https://github.com/localstack/localstack/pull/9697
* add resource providers for EC2::TransitGateway and EC2::TransitGatewayAttachment by pinzon in https://github.com/localstack/localstack/pull/9424
* add AWS::CloudFormation::Stack resource provider by pinzon in https://github.com/localstack/localstack/pull/9449
* fix: support for non-homogeneous lists by macnev2013 in https://github.com/localstack/localstack/pull/9717
* fix SNS publish across region exception by bentsku in https://github.com/localstack/localstack/pull/9679
* fix: supported multi account for test kinesis forward chain by macnev2013 in https://github.com/localstack/localstack/pull/9662

New Contributors
* lakkeger made their first contribution in https://github.com/localstack/localstack/pull/9672

**Full Changelog**: https://github.com/localstack/localstack/compare/v3.0.0...v3.0.1

<!-- Release notes generated using configuration in .github/release.yml at v3.0.0 -->

Summary

This is our third major release for LocalStack featuring both updates to our core services as well as auxiliary tooling. With our third major release for LocalStack we’re introducing improved service providers for ElastiCache, StepFunctions and S3, improved write performance in DynamoDB, increased Multi-Account and Multi-Region support and much more! A simplified networking configuration, new default container name and lots of internal refactoring to unify endpoint generation will help developers when testing their cloud applications locally.

Additionally to our core emulation in LocalStack we’ve released many additional features available in our Web Application such as IAM policy streams and a Chaos Engineering section to help you bulletproof your applications, both in terms of minimal permissions and increased robustness against failures. Our new Desktop application, LocalStack Desktop, has been released as the successor to our legacy Cockpit App and can be downloaded in the Web Application.

Several of these changes require a migration and we have done our best to make the migration for you as smooth as possible. Head to the *How to migrate* section and the linked resources there, to find out more. If you have trouble migrating to LocalStack 3.0 please reach out to us, we’re happy to help!

AWS Features

- Native `v2` provider for StepFunctions (default since 3.0.0)
- Native `v3` provider for S3 (default since 3.0.0)
- **Pro** New ElastiCache provider (default since 3.0.0)
- Huge performance improvements for DynamoDB write operations (1.6x for single `PutItem` and up to 10x for `BatchWriteItem`)
- Improved Multi-Account and Multi-Region support in multiple services such as CloudWatch, StepFunctions, EventBridge, Glue and more.
- The way ARNs are constructed internally has been significantly revamped. This change is particularly beneficial for users working with LocalStack in scenarios involving non-default account IDs or regions.
- Updating Lambda Event Source Mappings to point to different function versions has been fixed to now correctly switch the target and trigger the new version.
- We now offer both a Query and JSON-protocol support for SQS to support recent low-level changes in the SQS API
- DocumentDB has received support for `MasterUsername` and `MasterUserPassword`. With the feature flag `DOCDB_PROXY_CONTAINER=1` a proxied container is started, and Lambda can connect to the container using `LOCALSTACK_HOSTNAME`
- RDS now actually uses MySQL (instead of MariaDB) if the engine `mysql` is used. It now also correctly returns only the hostname in the `Endpoint` field of responses to the `CreateDBCluster` operation.
- Lots of incremental improvements to CloudFormation
- Improved detection of undefined dependencies in templates
- Support for Fn::Select in conditionals
- Fix AWS::S3::Bucket EventBridge Notifications
- Resources in Community
- (New) AWS::EC2::NetworkAcl
- (New) AWS::EC2::DHCPOptions
- (Updated) AWS::DynamoDB::Table
- (Updated) AWS::OpenSearch::Domain
- Resources in **Pro**
- (New) AWS::ElasticBeanstalk::Application
- (New) AWS::ElasticBeanstalk::ApplicationVersion
- (New) AWS::ElasticBeanstalk::Environment
- (New) AWS::ElasticBeanstalk::ConfigurationTemplate
- (Updated) AWS::RDS::DBCluster

LocalStack Features

- We now create **native M1 binaries of our CLI**. When [installing via Brew](https://docs.localstack.cloud/getting-started/installation/#localstack-cli) these are automatically selected for you depending on your CPU architecture.
- Since 3.0 we publish **major tags**. You can pin the current major version like this: `localstack/localstack-pro:3` to stay on the latest tagged 3.x release but avoid unintentionally upgrading to the next major version.
- With 3.0 we’re also now for the first time publishing a `stable` tag, which will always point towards the latest tagged release.
- The localstack docker image is now based on Python 3.11 and Debian Bookworm
- The default container name for LocalStack is now `localstack-main` (previously `localstack_main`) to allow the use of the name in URLs.
- Networking configuration has been simplified by removing legacy options and moving to `GATEWAY_LISTEN` and `LOCALSTACK_HOST`. Check out our [Discuss page](https://discuss.localstack.cloud/t/networking-migration-guide-for-localstack-3-0/588) for more information.
- Strict Service Loading allows you to define a strict subset of services to load via the `SERVICES` variable, e.g. `SERVICES=s3` . Any services not listed here will now be prevented from loading.
- [Lots of enhancements for LocalStack Extensions](https://docs.localstack.cloud/user-guide/extensions/)
- [**LocalStack Desktop**](https://docs.localstack.cloud/user-guide/tools/localstack-desktop/) is replacing the deprecated Cockpit Desktop UI
- The IAM policy stream is a new feature in our Web Application that allows you to see exactly which permissions are needed for the API calls you’re making in LocalStack.
- We’ve improved the Chaos Engineering capabilities of LocalStack, extending or FIS (Fault Injection Simulator) implementation and added a UI to interface with it in our Web Application.

Provider Deprecations

- StepFunctions `legacy` / `v1` provider has been deprecated and will be removed in the next major version.
- S3 `v2` provider has been deprecated and will be removed in the next major version.
- ElastiCache `legacy` provider has been deprecated and will be removed in the next major version.

Removals

- Lambda `legacy` / `v1` provider has been removed.
- S3 `legacy` / `v1` provider has been removed.
- We’ve removed a lot of legacy code with this major release. If you’ve been using any internal constructs from localstack, e.g. via extensions, please make sure they are still working. Feel free to reach out to us if you need help migrating your extension.
- Community Cloud Pods have been removed.
- After its initial preview phase, AWS RAM is now part of our paid offering and will be further developed and integrated with our IAM enforcement in future releases.
- [Configuration](https://docs.localstack.cloud/references/configuration/)
- `DEFAULT_REGION`, `USE_SINGLE_REGION`
- `ES_ENDPOINT_STRATEGY`, `ES_MULTI_CLUSTER`, `ES_CUSTOM_BACKEND`
- `KINESIS_INITIALIZE_STREAMS`
- `SYNCHRONOUS_*_EVENTS`
- `EC2_AUTOSTART_DAEMON`
- `*_PORT_EXTERNAL`
- legacy `LAMBDA_*` settings, see the sections below for more details

How to migrate

Networking

We have published an extensive migration guide for our networking related changes on [this Discuss page ](https://discuss.localstack.cloud/t/networking-migration-guide-for-localstack-3-0/588)

- The default container name is renamed from **`localstack_main`** to **`localstack-main`**
- Our default container name `localstack_main` is not a valid URL, so when the container name is used as a hostname, some libraries refuse to connect. With this release, we use the default container name of `localstack-main`. There may be breakages with tooling that expects the new container name, but a container is running with the old container name. Please update your tooling accordingly.
- Most prominently, this is container name used in `docker-compose` files.
- If you are using the LocalStack CLI, please just make sure to update to the latest version after the release. The CLI will handle this migration automatically.
- `HOSTNAME_EXTERNAL` and `LOCALSTACK_HOSTNAME` are removed in favor of `LOCALSTACK_HOST`
- We are simplifying how to configure LocalStack by fully switching over to use `LOCALSTACK_HOST` to configure URLs returned by AWS services. Please update your usages of `HOSTNAME_EXTERNAL` (default: `localhost`) and `LOCALSTACK_HOSTNAME` to use `LOCALSTACK_HOST` (default: `localhost.localstack.cloud:4566`). You can find more details in our [Networking Migration Guide for LocalStack 3.0](https://discuss.localstack.cloud/t/networking-migration-guide-for-localstack-3-0/588).

New default protocol for the SQS API

AWS recently updated the default protocol for the SQS API in many of their SDKs, which started breaking with LocalStack since we didn't have JSON support yet. With 3.0.0 we now support both protocols, but if you are still on 2.x a workaround would be to downgrade or pin your used SDK/tool version.

Here is the list with all the SDK versions where the issue will start appearing:
Language | SDK client repository | Required SDK client version
--- | --- | ---
C++ | [aws/aws-sdk-cpp](https://github.com/aws/aws-sdk-cpp) | [1.11.98](https://github.com/aws/aws-sdk-cpp/releases/tag/1.11.198)