Meltano

🐛 Fixes

- [8689](https://github.com/meltano/meltano/issues/8689) Emit a clearer error message when trying to set/unset an unknown setting in `.env`
- [8658](https://github.com/meltano/meltano/issues/8658) List only the state IDs within the specified prefix in the S3 URI
- [8698](https://github.com/meltano/meltano/issues/8698) `meltano config ... test` now uses the `elt.buffer` setting
- [8699](https://github.com/meltano/meltano/issues/8699) Add missing `project_readonly` setting to JSON schema
- [8691](https://github.com/meltano/meltano/issues/8691) Addressed `structlog` warning by removing `format_exc_info` from the processor chain

📚 Documentation Improvements

- [8721](https://github.com/meltano/meltano/issues/8721) Added instructions for installing Meltano with uv
- [8695](https://github.com/meltano/meltano/issues/8695) Fixed line highlighting and handling of `==` in code blocks

✨ New

- [8633](https://github.com/meltano/meltano/issues/8633) Added a `--only-install` option to commands that can auto-install plugins
- [8482](https://github.com/meltano/meltano/issues/8482) Plugins are now auto-installed when commands require them -- _**Thanks ReubenFrankel!**_
- [8620](https://github.com/meltano/meltano/issues/8620) Sensitive values in `meltano config <plugin>` are now hidden by default
- [8580](https://github.com/meltano/meltano/issues/8580) Added CLI `--refresh-catalog` option and extractor extra `use_cached_catalog` to ignore the cached source catalog

🐛 Fixes

- [8648](https://github.com/meltano/meltano/issues/8648) Listing Cloud (S3, GCS, etc.) state IDs no longer crashes if there is a file at the root of the bucket, and files in GCS buckets are only listed within the prefix specified in the `state_backend_uri` -- _**Thanks jx2lee!**_
- [8636](https://github.com/meltano/meltano/issues/8636) Values with `$` can now be escaped instead of trying to expand them from environment variables
- [8590](https://github.com/meltano/meltano/issues/8590) `meltano config ... test` now also checks for `BATCH` messages

⚙️ Under the Hood

- [8265](https://github.com/meltano/meltano/issues/8265) Use timezone-aware datetime objects

📚 Documentation Improvements

- [8646](https://github.com/meltano/meltano/issues/8646) Documented hot to escape setting values with `$`
- [8627](https://github.com/meltano/meltano/issues/8627) Fixed a broken link in the plugin concept page
- [8621](https://github.com/meltano/meltano/issues/8621) Update to current year and recommendations
- [8610](https://github.com/meltano/meltano/issues/8610) Remove Meltano Cloud docs
- [8609](https://github.com/meltano/meltano/issues/8609) Redirect Meltano Cloud docs to Arch docs
- [8608](https://github.com/meltano/meltano/issues/8608) Meltano Cloud has been shut down in favor of Arch -- _**Thanks hulet!**_
- [8505](https://github.com/meltano/meltano/issues/8505) Added 2024-Q2 changelog
- [8589](https://github.com/meltano/meltano/issues/8589) Recommend adding `namespace` key to custom plugins when migrating to Meltano 3
- [8578](https://github.com/meltano/meltano/issues/8578) Update `environments.md` to fix link
- [8570](https://github.com/meltano/meltano/issues/8570) Added a few dbt-postgres troubleshooting notes to the Getting Started guide
- [8566](https://github.com/meltano/meltano/issues/8566) Added a note about state IDs when using `meltano schedule run`

🐛 Fixes

- [8542](https://github.com/meltano/meltano/issues/8542) State from interrupted pipelines or using the `--merge-state` flag no longer causes crashes

📚 Documentation Improvements

- [8544](https://github.com/meltano/meltano/issues/8544) Added YAML docs examples of global and per-plugin `python` executable option

🐛 Fixes

- [8509](https://github.com/meltano/meltano/issues/8509) Mapper configuration is no longer ignored and is passed to direct mapper invocations as well as mappings in pipelines
- [8527](https://github.com/meltano/meltano/issues/8527) Made the output of `meltano select ... list` consistent between different Python versions
- [8213](https://github.com/meltano/meltano/issues/8213) `meltano config <plugin> test` false-negative on Windows -- _**Thanks ReubenFrankel!**_
- [8508](https://github.com/meltano/meltano/issues/8508) Cron regex pattern on meltano.schema.json -- _**Thanks sabino!**_

⚙️ Under the Hood

- [8470](https://github.com/meltano/meltano/issues/8470) Started enforcing usage of `structlog.stdlib.get_logger` over `logging.getLogger` and banned use of the root logger
- [8510](https://github.com/meltano/meltano/issues/8510) Plugin installation status is now logged instead of printed

📚 Documentation Improvements

- [8524](https://github.com/meltano/meltano/issues/8524) Changed references of Airflow `orchestrator` to `utility`
- [8506](https://github.com/meltano/meltano/issues/8506) Document `venv.backend` usage to configure `uv`

✨ New

- [8459](https://github.com/meltano/meltano/issues/8459) `meltano run` now has a `--run-id` option to allow for custom run UUIDs
- [8465](https://github.com/meltano/meltano/issues/8465) Support `uv` as an optional virtualenv backend
- [8355](https://github.com/meltano/meltano/issues/8355) Support installing multiple plugins of any type -- _**Thanks ReubenFrankel!**_

🐛 Fixes

- [8486](https://github.com/meltano/meltano/issues/8486) "`kind: {kind}` is deprecated..." is no longer logged if the corresponding replacement is in place
- [8489](https://github.com/meltano/meltano/issues/8489) Environment variables from `.env` are now passed to the plugin installation subprocesses
- [8490](https://github.com/meltano/meltano/issues/8490) An explicit error message is now logged when Meltano fails to retrieve tap state from the state backend
- [8447](https://github.com/meltano/meltano/issues/8447) `meltano run` no longer creates empty `venv` plugin directories for inherited plugins
- [8446](https://github.com/meltano/meltano/issues/8446) Added `run_id` and `job_name` properties to `meltano run` log messages

⚙️ Under the Hood

- [8499](https://github.com/meltano/meltano/issues/8499) Only lookup uv executable once
- [8469](https://github.com/meltano/meltano/issues/8469) Fixed some log serialization issues with `meltano.core.proj…ec_plugins_service.DefinitionSource` and `meltano.core.plugin.project_plugin.ProjectPlugin`

📚 Documentation Improvements

- [8449](https://github.com/meltano/meltano/issues/8449) Fixed a broken link to custom plugin definitions in the project concept page
- [8432](https://github.com/meltano/meltano/issues/8432) Added the 2024-Q1 changelog

🐛 Fixes

- [8436](https://github.com/meltano/meltano/issues/8436) Terminal output from plugin installation is now safely decoded
- [8381](https://github.com/meltano/meltano/issues/8381) Print `Plugin definition is already locked` to stdout instead of stderr
- [8399](https://github.com/meltano/meltano/issues/8399) Handle non-UTF-8 lines in plugin output for logging -- _**Thanks nkclemson!**_

📚 Documentation Improvements

- [8434](https://github.com/meltano/meltano/issues/8434) Added a note about using the `--require-virtualenv` flag for installing Meltano with pip
- [8433](https://github.com/meltano/meltano/issues/8433) Removed some stale references to the old API