Meltano

✨ New

- [8258](https://github.com/meltano/meltano/issues/8258) Add a `--merge-state` flag to `meltano run` to merge the current pipeline state with that of the latest run
- [8268](https://github.com/meltano/meltano/issues/8268) Expand environment variables in array setting values

🐛 Fixes

- [8301](https://github.com/meltano/meltano/issues/8301) Interactive config now indicates that you're typing a redacted value -- _**Thanks abastola0!**_

✨ New

- [8184](https://github.com/meltano/meltano/issues/8184) Log Meltano version and Operating System at invocation of CLI -- _**Thanks ashu565!**_
- [8228](https://github.com/meltano/meltano/issues/8228) Support setting configuration from files and STDIN -- _**Thanks XshubhamX!**_
- [8194](https://github.com/meltano/meltano/issues/8194) Allow escaping stream names with periods in `select` rules
- [8241](https://github.com/meltano/meltano/issues/8241) Support Python 3.12
- [8215](https://github.com/meltano/meltano/issues/8215) Support authenticating to Azure state backend without a connection string -- _**Thanks XshubhamX!**_

🐛 Fixes

- [8249](https://github.com/meltano/meltano/issues/8249) Display special characters in column names in the output of `meltano select --list`
- [8227](https://github.com/meltano/meltano/issues/8227) Validate input to settings with `kind: options`
- [8232](https://github.com/meltano/meltano/issues/8232) Interval validation for `meltano schedule set` -- _**Thanks XshubhamX!**_
- [8225](https://github.com/meltano/meltano/issues/8225) Redirect tap's stderr to /dev/null during a configuration test -- _**Thanks raiatul14!**_

📚 Documentation Improvements

- [8267](https://github.com/meltano/meltano/issues/8267) Add Q4 Changelog
- [8260](https://github.com/meltano/meltano/issues/8260) Add information about database schema destination -- _**Thanks EChaffraix!**_
- [8259](https://github.com/meltano/meltano/issues/8259) Fix links in v3 migration guide
- [8251](https://github.com/meltano/meltano/issues/8251) Fix dbt model in part3.mdx -- _**Thanks diegoquintanav!**_
- [8214](https://github.com/meltano/meltano/issues/8214) Document other supported ways of configuring an S3 endpoint URL
- [8211](https://github.com/meltano/meltano/issues/8211) Sync sidebar order with index page link-lists, remove broken /index links -- _**Thanks mjsqu!**_
- [8209](https://github.com/meltano/meltano/issues/8209) Remove broken link (reference/index) and order links to match sidebar -- _**Thanks mjsqu!**_
- [8210](https://github.com/meltano/meltano/issues/8210) Add tabs for all remaining env/cli/config settings -- _**Thanks mjsqu!**_
- [8201](https://github.com/meltano/meltano/issues/8201) Use tabs for examples on settings page -- _**Thanks mjsqu!**_
- [8200](https://github.com/meltano/meltano/issues/8200) Update contribution guidelines -- _**Thanks mjsqu!**_
- [8155](https://github.com/meltano/meltano/issues/8155) Add september changelog

✨ New

- [8169](https://github.com/meltano/meltano/issues/8169) Added `--force-install` CLI flag for meltano `add` command. -- _**Thanks XshubhamX!**_
- [8145](https://github.com/meltano/meltano/issues/8145) Save pip logs to a file in the system directory
- [7907](https://github.com/meltano/meltano/issues/7907) Add plugin from ref -- _**Thanks ReubenFrankel!**_

🐛 Fixes

- [8179](https://github.com/meltano/meltano/issues/8179) Removed the `--verbose` option from CLI, which no longer had any effect -- _**Thanks arorarohan981!**_
- [8044](https://github.com/meltano/meltano/issues/8044) Better error message when Azure connection string is missing
- [8115](https://github.com/meltano/meltano/issues/8115) Do not perform destructive state ops when answering 'no' in prompt

📚 Documentation Improvements

- [8178](https://github.com/meltano/meltano/issues/8178) Top-level ordered lists are now rendered correctly in docs
- [8156](https://github.com/meltano/meltano/issues/8156) Added docs for --cwd CLI option -- _**Thanks XshubhamX!**_
- [8143](https://github.com/meltano/meltano/issues/8143) Remove Cloud announcement banner
- [8113](https://github.com/meltano/meltano/issues/8113) Update Cloud "Getting Started" guide to include the lock command
- [8111](https://github.com/meltano/meltano/issues/8111) Add example of database URI for SQL Server -- _**Thanks wesseljt!**_
- [8087](https://github.com/meltano/meltano/issues/8087) Add cloud state command

BREAKING CHANGES

- [8041](https://github.com/meltano/meltano/issues/8041) Remove `target_schema` loader extra
- [8007](https://github.com/meltano/meltano/issues/8007) Always require plugin lock files
- [7499](https://github.com/meltano/meltano/issues/7499) Remove API and web UI
- [7656](https://github.com/meltano/meltano/issues/7656) Remove the `meltano discover` command

✨ New

- [8020](https://github.com/meltano/meltano/issues/8020) Add [`python` setting](https://docs.meltano.com/reference/settings#python)
- [7997](https://github.com/meltano/meltano/issues/7997) Add [`el` command](https://docs.meltano.com/reference/command-line-interface#el) as an alias of `elt` and deprecate both `elt` and the `--transform` option
- [7992](https://github.com/meltano/meltano/issues/7992) Add support for mappers in the invoke command
- [7989](https://github.com/meltano/meltano/issues/7989) Add `meltano hub ping` command
- [7984](https://github.com/meltano/meltano/issues/7984) Add `meltano config --unsafe` flag -- _**Thanks ReubenFrankel!**_
- [7981](https://github.com/meltano/meltano/issues/7981) Support `psycopg[binary]` under a new `postgres` extra
- [7963](https://github.com/meltano/meltano/issues/7963) Bump SQLAlchemy to 2.0
- [7932](https://github.com/meltano/meltano/issues/7932) Add "did you mean" CLI command name suggestions
- [7846](https://github.com/meltano/meltano/issues/7846) Add aliases for the `once` schedule interval

🐛 Fixes

- [8042](https://github.com/meltano/meltano/issues/8042) Ensure migration lock file is closed after read
- [8043](https://github.com/meltano/meltano/issues/8043) Ensure elt/run log file is closed
- [8031](https://github.com/meltano/meltano/issues/8031) Redact DB password from logs
- [8015](https://github.com/meltano/meltano/issues/8015) Display a better error message when database URI is null
- [7982](https://github.com/meltano/meltano/issues/7982) Use hyphens consistently for CLI options
- [7947](https://github.com/meltano/meltano/issues/7947) Support [PEP 440 direct references](https://peps.python.org/pep-0440/#direct-references) in `pip_url`

⚙️ Under the Hood

- [7964](https://github.com/meltano/meltano/issues/7964) Replace deprecated `locale.getdefaultlocale` with `locale.getlocale` -- _**Thanks AmirAflak!**_
- [7960](https://github.com/meltano/meltano/issues/7960) Compatibility with SQLAlchemy 2

📚 Documentation Improvements

- [8011](https://github.com/meltano/meltano/issues/8011) Add JSON Schema information -- _**Thanks anden-akkio!**_
- [7991](https://github.com/meltano/meltano/issues/7991) Fix cloud install git URL
- [7975](https://github.com/meltano/meltano/issues/7975) Link `mssql` additional component to system database explanation
- [7979](https://github.com/meltano/meltano/issues/7979) Correct `repo_ext` to `ext_repo` for plugin definition syntax -- _**Thanks ReubenFrankel!**_
- [7953](https://github.com/meltano/meltano/issues/7953) Update tagline in readme
- [7951](https://github.com/meltano/meltano/issues/7951) Update changelog
- [7950](https://github.com/meltano/meltano/issues/7950) Fix logging example -- _**Thanks aminebeh!**_
- [7948](https://github.com/meltano/meltano/issues/7948) Update docusaurus.config.js -- _**Thanks gridig!**_
- [7945](https://github.com/meltano/meltano/issues/7945) Douwe fixes
- [7944](https://github.com/meltano/meltano/issues/7944) Quick doc fixes
- [7936](https://github.com/meltano/meltano/issues/7936) Migrate Meltano docs to Docusaurus
- [7902](https://github.com/meltano/meltano/issues/7902) Remove ELT messaging, move things around
- [7931](https://github.com/meltano/meltano/issues/7931) Cloud docs ssh key validate tip
- [7930](https://github.com/meltano/meltano/issues/7930) Meltano cloud to meltano-cloud
- [7926](https://github.com/meltano/meltano/issues/7926) Fix state backend env vars in examples

✨ New

- [7733](https://github.com/meltano/meltano/issues/7733) Add setting `hidden` flag -- _**Thanks ReubenFrankel!**_

🐛 Fixes

- [7878](https://github.com/meltano/meltano/issues/7878) Redact sensitive values in `config list` output -- _**Thanks ReubenFrankel!**_
- [7725](https://github.com/meltano/meltano/issues/7725) Restrict Azure state logging to WARNING and above -- _**Thanks acarter24!**_
- [7745](https://github.com/meltano/meltano/issues/7745) Python code formatting in Custom Extractor docs -- _**Thanks rawwar!**_

⚡ Performance Improvements

- [7811](https://github.com/meltano/meltano/issues/7811) Optimize migration 6828cc5b1a4f_create_dedicated_state_table.py -- _**Thanks asmisha!**_

📚 Documentation Improvements

- [7911](https://github.com/meltano/meltano/issues/7911) Advanced docs on running custom scripts
- [7917](https://github.com/meltano/meltano/issues/7917) Update instructions for providing `GIT_SSH_PRIVATE_KEY`
- [7906](https://github.com/meltano/meltano/issues/7906) Recommend airflow utility over orchestrator
- [7892](https://github.com/meltano/meltano/issues/7892) Fix onboarding.md config command
- [7668](https://github.com/meltano/meltano/issues/7668) Document `meltano-cloud job stop`
- [7837](https://github.com/meltano/meltano/issues/7837) Update environment example to be more complete
- [7836](https://github.com/meltano/meltano/issues/7836) Add more detail for cloud history command
- [7817](https://github.com/meltano/meltano/issues/7817) Update Meltano Cloud notice in Deployment doc
- [7823](https://github.com/meltano/meltano/issues/7823) Add cloud deployment hints for common errors
- [7816](https://github.com/meltano/meltano/issues/7816) Remove Kubernetes reference from Production doc
- [7822](https://github.com/meltano/meltano/issues/7822) Fix plural deployments cli command
- [7807](https://github.com/meltano/meltano/issues/7807) Update schedule interval with single quotes
- [7795](https://github.com/meltano/meltano/issues/7795) Add note on ephemeral storage
- [7758](https://github.com/meltano/meltano/issues/7758) Cloud docs content and better navigation from index
- [7783](https://github.com/meltano/meltano/issues/7783) Part3 getting started guide dbt initialize section
- [7782](https://github.com/meltano/meltano/issues/7782) Use `--interactive` flag in Loader configuration section of Getting Started
- [7780](https://github.com/meltano/meltano/issues/7780) Fix indentation issue for code block in Getting Started
- [7619](https://github.com/meltano/meltano/issues/7619) 7186: change transform to utility
- [7765](https://github.com/meltano/meltano/issues/7765) Use tabs for meltano.yml vs meltano config or env -- _**Thanks mjsqu!**_
- [7764](https://github.com/meltano/meltano/issues/7764) Explain Cloud schedule offsets
- [7763](https://github.com/meltano/meltano/issues/7763) Make quoting consistent for intervals
- [7754](https://github.com/meltano/meltano/issues/7754) Update deployment details
- [7753](https://github.com/meltano/meltano/issues/7753) Update `project use` to include `--name` flag
- [7750](https://github.com/meltano/meltano/issues/7750) Update `onboarding.md` to use `--environment` kwarg for deployments -- _**Thanks GJMcClintock!**_
- [7744](https://github.com/meltano/meltano/issues/7744) Fix `mappers.md` sample command