Meltano

🐛 Fixes

- [9173](https://github.com/meltano/meltano/issues/9173) Avoid parsing valid ISO 8601 strings

📦 Packaging changes

- [9171](https://github.com/meltano/meltano/issues/9171) Bump `tzlocal` to 5.3

✨ New

- [9158](https://github.com/meltano/meltano/issues/9158) Pass project `env` to installation environment
- [9119](https://github.com/meltano/meltano/issues/9119) Parse relative dates in plugin config
- [9019](https://github.com/meltano/meltano/issues/9019) Set `application/json` as the content type for blobs uploaded with the GCS state backend
- [8367](https://github.com/meltano/meltano/issues/8367) Support state backend and setting add-ons
- [9047](https://github.com/meltano/meltano/issues/9047) Added a default Meltano User-Agent env var that plugins can refer to in config
- [9077](https://github.com/meltano/meltano/issues/9077) Pass a default logging configuration for Pipelinewise and Singer SDK extractors, loaders and mappers
- [9046](https://github.com/meltano/meltano/issues/9046) The `process` key containing the process ID for a Meltano invocation is now added to logs when `callsite_parameters: true` is used
- [9018](https://github.com/meltano/meltano/issues/9018) Add descriptions to Meltano's internal settings
- [8975](https://github.com/meltano/meltano/issues/8975) Added a `--log-format` option as a shorcut to quickly change the format of logs
- [8991](https://github.com/meltano/meltano/issues/8991) Uv venv backend is no longer experimental
- [8951](https://github.com/meltano/meltano/issues/8951) Add a simple log formatter that only contains the event by default

🐛 Fixes

- [9162](https://github.com/meltano/meltano/issues/9162) Stringify YAML values from top-level `env` key of `meltano.yml`
- [9153](https://github.com/meltano/meltano/issues/9153) Display catalog file contents when it cannot be parsed as valid JSON
- [9148](https://github.com/meltano/meltano/issues/9148) Send first heartbeat when initializing job
- [9117](https://github.com/meltano/meltano/issues/9117) Avoid prepending a slash to state file path in Cloud state backends
- [9045](https://github.com/meltano/meltano/issues/9045) Added help to `--extras` option of `meltano config ... list`
- [9035](https://github.com/meltano/meltano/issues/9035) Limit boto3 to < 1.36 to fix incompatibility with Minio (S3-compatible state backend)
- [9003](https://github.com/meltano/meltano/issues/9003) Disable local variables by default in JSON logs
- [8973](https://github.com/meltano/meltano/issues/8973) Print the time when the job will go stale if no more heartbeats are sent

⚙️ Under the Hood

- [9165](https://github.com/meltano/meltano/issues/9165) Refactor base state backend so that a lock is always acquired when supported
- [9000](https://github.com/meltano/meltano/issues/9000) Use `anyio` to open `pathlib.Path` instances
- [8972](https://github.com/meltano/meltano/issues/8972) Enable Ruff `ASYNC` rules, open files with `anyio` and run subprocess with `asyncio.create_subprocess_exec` in async contexts

📚 Documentation Improvements

- [9116](https://github.com/meltano/meltano/issues/9116) Mention `meltano schedule run` whenever we discuss `meltano schedule`
- [9115](https://github.com/meltano/meltano/issues/9115) Document common `metadata` keys
- [9109](https://github.com/meltano/meltano/issues/9109) Updated the contributing guide
- [9084](https://github.com/meltano/meltano/issues/9084) Use `meltano-map-transform` PyPI distribution in examples
- [9069](https://github.com/meltano/meltano/issues/9069) Update plugin development guide to use uv
- [9055](https://github.com/meltano/meltano/issues/9055) Update CLI examples to use `tap-shopify`
- [9048](https://github.com/meltano/meltano/issues/9048) Document `plain` option of `cli.log_format`
- [9011](https://github.com/meltano/meltano/issues/9011) Fixed small indent issue in mapper YAML example
- [8992](https://github.com/meltano/meltano/issues/8992) Added 2024-Q4 changelog
- [8983](https://github.com/meltano/meltano/issues/8983) Use a different repo in part 1 of Getting Started guide -- _**Thanks martinburch!**_
- [8969](https://github.com/meltano/meltano/issues/8969) Document `database_uri` examples for supported backends
- [8961](https://github.com/meltano/meltano/issues/8961) Change to code theme that does not italicize keywords or variables -- _**Thanks ReubenFrankel!**_

📦 Packaging changes

- [9139](https://github.com/meltano/meltano/issues/9139) Switch to uv 🚀
- [9092](https://github.com/meltano/meltano/issues/9092) Bump psutil from 6.1.1 to 7.0.0
- [9089](https://github.com/meltano/meltano/issues/9089) Bump `check-jsonschema` and `ruamel.yaml`
- [9088](https://github.com/meltano/meltano/issues/9088) Always install `uv` with Meltano
- [9032](https://github.com/meltano/meltano/issues/9032) Bump structlog from 24.4.0 to 25.1.0
- [8980](https://github.com/meltano/meltano/issues/8980) Bump croniter from 5.0.1 to 6.0.0
- [8979](https://github.com/meltano/meltano/issues/8979) Bump the runtime-dependencies group with 6 updates
- [8981](https://github.com/meltano/meltano/issues/8981) Bump jinja2 from 3.1.4 to 3.1.5
- [8968](https://github.com/meltano/meltano/issues/8968) Bump the runtime-dependencies group with 2 updates

✨ New

- [8944](https://github.com/meltano/meltano/issues/8944) Suggest verifying stream selection after `meltano config ... test` fails
- [8917](https://github.com/meltano/meltano/issues/8917) Bumped the default `elt.buffer_size` to 100 MiB
- [8913](https://github.com/meltano/meltano/issues/8913) Include the Python version and machine type in system debug log message
- [8894](https://github.com/meltano/meltano/issues/8894) Fields marked as `unsupported` in the catalog are now marked as such in the output of `meltano select --list --all`
- [8889](https://github.com/meltano/meltano/issues/8889) The `args` attribute of plugin commands is now optional
- [8786](https://github.com/meltano/meltano/issues/8786) Added an `--all` flag to `meltano state clear` to delete all state IDs -- _**Thanks fauzxan!**_
- [8735](https://github.com/meltano/meltano/issues/8735) Add Content-Type to S3 state file uploads
- [8844](https://github.com/meltano/meltano/issues/8844) Support an environment variable for the `--full-refresh` flag -- _**Thanks MutuT2!**_
- [8618](https://github.com/meltano/meltano/issues/8618) Python 3.13 is now supported
- [8737](https://github.com/meltano/meltano/issues/8737) Added `exceptions` to the log message when using the JSON formatter
- [8626](https://github.com/meltano/meltano/issues/8626) Added a `--run-id` option to `meltano el[t]`
- [8494](https://github.com/meltano/meltano/issues/8494) Added a `callsite_parameters` argument to the builtin log formatters, which adds source path, line number and function name fields to the emitted log

🐛 Fixes

- [8949](https://github.com/meltano/meltano/issues/8949) Add newline at the end of plugin lock files
- [8914](https://github.com/meltano/meltano/issues/8914) Ask for confirmation in `meltano config ... reset`
- [8869](https://github.com/meltano/meltano/issues/8869) Adding User friendly loader error when the loader is missing from the Meltano run. -- _**Thanks NishitSingh2023!**_
- [8852](https://github.com/meltano/meltano/issues/8852) Using the `--force` flag of `meltano install` no longer causes plugin installation to crash when using the `uv` venv backend
- [8828](https://github.com/meltano/meltano/issues/8828) Show the correct value in the "Current value is still" warning for `meltano config set` -- _**Thanks ReubenFrankel!**_
- [8815](https://github.com/meltano/meltano/issues/8815) A mapper is now auto-installed when one of its mappings is used in a command -- _**Thanks ReubenFrankel!**_

⚙️ Under the Hood

- [8851](https://github.com/meltano/meltano/issues/8851) Decoupled the `JobState` ORM model of the system db from state store implementations
- [8898](https://github.com/meltano/meltano/issues/8898) Use `importlib.resources` to read package files and use `importlib.metadata` to detect "editable" installations (via PEP 610)
- [8830](https://github.com/meltano/meltano/issues/8830) Dropped support for EOL Python 3.8

📚 Documentation Improvements

- [8950](https://github.com/meltano/meltano/issues/8950) Document Git requirement and add `uv` section
- [8937](https://github.com/meltano/meltano/issues/8937) Use tabs for code blocks with OS-specific instructions in Getting Started guide
- [8934](https://github.com/meltano/meltano/issues/8934) Document a logging example to log at DEBUG level but excluding extractor/loader stdout
- [8909](https://github.com/meltano/meltano/issues/8909) Update part1.mdx
- [8829](https://github.com/meltano/meltano/issues/8829) Update Azure state backend connection documentation for DefaultAzureCredential -- _**Thanks acarter24!**_
- [8809](https://github.com/meltano/meltano/issues/8809) Bumped Docusaurus to 3.1, fixed broken links and started printing warnings on broken anchors
- [8752](https://github.com/meltano/meltano/issues/8752) Added 2024-Q3 changelog
- [8808](https://github.com/meltano/meltano/issues/8808) Fixed broken anchor links in settings page

📦 Packaging changes

- [8956](https://github.com/meltano/meltano/issues/8956) Bump the runtime-dependencies group with 3 updates
- [8947](https://github.com/meltano/meltano/issues/8947) Bump the runtime-dependencies group with 3 updates
- [8943](https://github.com/meltano/meltano/issues/8943) Bump the runtime-dependencies group with 2 updates
- [8931](https://github.com/meltano/meltano/issues/8931) Bump the runtime-dependencies group with 6 updates
- [8907](https://github.com/meltano/meltano/issues/8907) Bump the runtime-dependencies group with 4 updates
- [8910](https://github.com/meltano/meltano/issues/8910) Bump aiohttp from 3.10.10 to 3.10.11
- [8883](https://github.com/meltano/meltano/issues/8883) Bump the runtime-dependencies group with 4 updates
- [8873](https://github.com/meltano/meltano/issues/8873) Bump the runtime-dependencies group with 4 updates
- [8860](https://github.com/meltano/meltano/issues/8860) Bump the runtime-dependencies group with 3 updates
- [8849](https://github.com/meltano/meltano/issues/8849) Bump the runtime-dependencies group with 2 updates
- [8841](https://github.com/meltano/meltano/issues/8841) Bump boto3 from 1.35.41 to 1.35.42 in the runtime-dependencies group

🐛 Fixes

- [8802](https://github.com/meltano/meltano/issues/8802) No longer fail on uploading state to S3 when the object does not initially exist
- [8800](https://github.com/meltano/meltano/issues/8800) Failure message is now correctly printed when a plugin can not be removed from the system database

🐛 Fixes

- [8784](https://github.com/meltano/meltano/issues/8784) Inheriting plugins are no longer always auto-installed -- _**Thanks ReubenFrankel!**_
- [8785](https://github.com/meltano/meltano/issues/8785) Install plugins correctly given multiple levels of inheritance -- _**Thanks ReubenFrankel!**_

📚 Documentation Improvements

- [8779](https://github.com/meltano/meltano/issues/8779) Fix layout of troubleshooting page

🐛 Fixes

- [8770](https://github.com/meltano/meltano/issues/8770) Redact secret settings by default in `meltano compile` -- _**Thanks holly-evans!**_
- [8731](https://github.com/meltano/meltano/issues/8731) Valid options are now printed for the `--interval` option of the schedule subcommand

⚙️ Under the Hood

- [8762](https://github.com/meltano/meltano/issues/8762) Remove `record-flattening` capability in favour of `schema-flattening` -- _**Thanks ReubenFrankel!**_
- [8748](https://github.com/meltano/meltano/issues/8748) Move `install_plugins` to `meltano.core.plugin_install_service`
- [8732](https://github.com/meltano/meltano/issues/8732) Use `uv venv` instead of `uv virtualenv` alias

📚 Documentation Improvements

- [8764](https://github.com/meltano/meltano/issues/8764) Migrate to Docusaurus v3
- [8756](https://github.com/meltano/meltano/issues/8756) Updated docs to reference `meltano-dbt-ext` PyPI distribution