Astronomer-cosmos

--------------------

Features

* Add dbt docs natively in Airflow via plugin by dwreeves in 737
* Add support for ``InvocationMode.DBT_RUNNER`` for local execution mode by jbandoro in 850
* Support partial parsing to render DAGs faster when using ``ExecutionMode.LOCAL``, ``ExecutionMode.VIRTUALENV`` and ``LoadMode.DBT_LS`` by dwreeves in 800
* Improve performance by 22-35% or more by caching partial parse artefact by tatiana in 904
* Add Azure Container Instance as Execution Mode by danielvdende in 771
* Add dbt build operators by dylanharper-qz in 795
* Add dbt profile config variables to mapped profile by ykuc in 794
* Add more template fields to ``DbtBaseOperator`` by dwreeves in 786
* Add ``pip_install_options`` argument to operators by octiva in 808

Bug fixes

* Make ``PostgresUserPasswordProfileMapping`` schema argument optional by FouziaTariq in 683
* Fix ``folder_dir`` not showing on logs for ``DbtDocsS3LocalOperator`` by PrimOox in 856
* Improve ``dbt ls`` parsing resilience to missing tags/config by tatiana in 859
* Fix ``operator_args`` modified in place in Airflow converter by jbandoro in 835
* Fix Docker and Kubernetes operators execute method resolution by jbandoro in 849
* Fix ``TrinoBaseProfileMapping`` required parameter for non method authentication by AlexandrKhabarov in 921
* Fix global flags for lists by ms32035 in 863
* Fix ``GoogleCloudServiceAccountDictProfileMapping`` when getting values from the Airflow connection ``extra__`` keys by glebkrapivin in 923
* Fix using the dag as a keyword argument as ``specific_args_keys`` in DbtTaskGroup by tboutaour in 916
* Fix ACI integration (``DbtAzureContainerInstanceBaseOperator``) by danielvdende in 872
* Fix setting dbt project dir to the tmp dir by dwreeves in 873
* Fix dbt docs operator to not use ``graph.gpickle`` file when ``--no-write-json`` is passed by dwreeves in 883
* Make Pydantic a required dependency by pankajkoti in 939
* Gracefully error if users try to ``emit_datasets`` with ``Airflow 2.9.0`` or ``2.9.1`` by tatiana in 948
* Fix parsing tests that have no parents in 933 by jlaneve
* Correct ``root_path`` in partial parse cache by pankajkoti in 950

Docs

* Fix docs homepage link by jlaneve in 860
* Fix docs ``ExecutionConfig.dbt_project_path`` by jbandoro in 847
* Fix typo in MWAA getting started guide by jlaneve in 846
* Fix typo related to exporting docs to GCS by tboutaour in 922
* Improve partial parsing docs by tatiana in 898
* Improve docs for datasets for airflow >= 2.4 by SiddiqueAhmad in 879
* Improve test behaviour docs to highlight ``warning`` feature in the ``virtualenv`` mode by mc51 in 910
* Fix docs typo by SiddiqueAhmad in 917
* Improve Astro docs by RNHTTR in 951

Others

* Add performance integration tests by jlaneve in 827
* Enable ``append_env`` in ``operator_args`` by default by tatiana in 899
* Change default ``append_env`` behaviour depending on Cosmos ``ExecutionMode`` by pankajkoti and pankajastro in 954
* Expose the ``dbt`` graph in the ``DbtToAirflowConverter`` class by tommyjxl in 886
* Improve dbt docs plugin rendering padding by dwreeves in 876
* Add ``connect_retries`` to databricks profile to fix expensive integration failures by jbandoro in 826
* Add import sorting (isort) to Cosmos by jbandoro in 866
* Add Python 3.11 to CI/tests by tatiana and jbandoro in 821, 824 and 825
* Fix failing ``test_created_pod`` for ``apache-airflow-providers-cncf-kubernetes`` after v8.0.0 update by jbandoro in 854
* Extend ``DatabricksTokenProfileMapping`` test to include session properties by tatiana in 858
* Fix broken integration test uncovered from Pytest 8.0 update by jbandoro in 845
* Add Apache Airflow 2.9 to the test matrix by tatiana in 940
* Replace deprecated ``DummyOperator`` by ``EmptyOperator`` if Airflow >=2.4.0 by tatiana in 900
* Improve logs to troubleshoot issue in 1.4.0a2 with astro-cli by tatiana in 947
* Fix issue when publishing a new release to PyPI by tatiana in 946
* Pre-commit hook updates in 820, 834, 843 and 852, 890, 896, 901, 905, 908, 919, 931, 941

------------------

Bug fixes

* Fix: ensure ``DbtGraph.update_node_dependency`` is called for all load methods by jbandoro in 803
* Fix: ensure operator ``execute`` method is consistent across all execution base subclasses by jbandoro in 805
* Fix custom selector when ``test`` node has no ``depends_on`` values by tatiana in 814
* Fix forwarding selectors to test task when using ``TestBehavior.AFTER_ALL`` by tatiana in 816

Others

* Docs: Remove incorrect docstring from ``DbtLocalBaseOperator`` by jakob-hvitnov-telia in 797
* Add more logs to troubleshoot custom selector by tatiana in 809
* Fix OpenLineage integration documentation by tatiana in 810
* Fix test dependencies after Airflow 2.8 release by jbandoro and tatiana in 806
* Use Airflow constraint file for test environment setup by jbandoro in 812
* pre-commit updates in 799, 807

------------------

Bug fixes

* Fix disable event tracking throwing error by jbandoro in 784
* Fix support for string path for ``LoadMode.DBT_LS_FILE`` and docs by flinz in 788
* Remove stack trace to disable unnecessary K8s error by tatiana in 790

Others

* Update examples to use the astro-runtime 10.0.0 by RNHTTR in 777
* Docs: add missing imports for mwaa getting started by Benjamin0313 in 792
* Refactor common executor constructors with test coverage by jbandoro in 774
* pre-commit updates in 789

------------------

Features

* Add new parsing method ``LoadMode.DBT_LS_FILE`` by woogakoki in 733 (`documentation <https://astronomer.github.io/astronomer-cosmos/configuration/parsing-methods.html#dbt-ls-file>`_).
* Add support to select using (some) graph operators when using ``LoadMode.CUSTOM`` and ``LoadMode.DBT_MANIFEST`` by tatiana in 728 (`documentation <https://astronomer.github.io/astronomer-cosmos/configuration/selecting-excluding.html#using-select-and-exclude>`_)
* Add support for dbt ``selector`` arg for DAG parsing by jbandoro in 755 (`documentation <https://astronomer.github.io/astronomer-cosmos/configuration/render-config.html#render-config>`_).
* Add ``ProfileMapping`` for Vertica by perttus in 540, 688 and 741 (`documentation <https://astronomer.github.io/astronomer-cosmos/profiles/VerticaUserPassword.html>`_).
* Add ``ProfileMapping`` for Snowflake encrypted private key path by ivanstillfront in 608 (`documentation <https://astronomer.github.io/astronomer-cosmos/profiles/SnowflakeEncryptedPrivateKeyFilePem.html>`_).
* Add support for Snowflake encrypted private key environment variable by DanMawdsleyBA in 649
* Add ``DbtDocsGCSOperator`` for uploading dbt docs to GCS by jbandoro in 616, (`documentation <https://astronomer.github.io/astronomer-cosmos/configuration/generating-docs.html#upload-to-gcs>`_).
* Add cosmos/propagate_logs Airflow config support for disabling log propagation by agreenburg in 648 (`documentation <https://astronomer.github.io/astronomer-cosmos/configuration/logging.html>`_).
* Add operator_args ``full_refresh`` as a templated field by joppevos in 623
* Expose environment variables and dbt variables in ``ProjectConfig`` by jbandoro in 735 (`documentation <https://astronomer.github.io/astronomer-cosmos/configuration/project-config.html#project-config-example>`_).
* Support disabling event tracking when using Cosmos profile mapping by jbandoro in 768 (`documentation <https://astronomer.github.io/astronomer-cosmos/profiles/index.html#disabling-dbt-event-tracking>`_).

Enhancements

* Make Pydantic an optional dependency by pixie79 in 736
* Create a symbolic link to ``dbt_packages`` when ``dbt_deps`` is False when using ``LoadMode.DBT_LS`` by DanMawdsleyBA in 730
* Add ``aws_session_token`` for Athena mapping by benjamin-awd in 663
* Retrieve temporary credentials from ``conn_id`` for Athena by octiva in 758
* Extend ``DbtDocsLocalOperator`` with static flag by joppevos in 759

Bug fixes

* Remove Pydantic upper version restriction so Cosmos can be used with Airflow 2.8 by jlaneve in 772

Others

* Replace flake8 for Ruff by joppevos in 743
* Reduce code complexity to 8 by joppevos in 738
* Speed up integration tests by jbandoro in 732
* Fix README quickstart link in by RNHTTR in 776
* Add package location to work with hatchling 1.19.0 by jbandoro in 761
* Fix type check error in ``DbtKubernetesBaseOperator.build_env_args`` by jbandoro in 766
* Improve ``DBT_MANIFEST`` documentation by dwreeves in 757
* Update conflict matrix between Airflow and dbt versions by tatiana in 731 and 779
* pre-commit updates in 775, 770, 762

------------------

Bug fixes

* Fix running models that use alias while supporting dbt versions by binhnq94 in 662
* Make ``profiles_yml_path`` optional for ``ExecutionMode.DOCKER`` and ``KUBERNETES`` by MrBones757 in 681
* Prevent overriding dbt profile fields with profile args of "type" or "method" by jbandoro in 702
* Fix ``LoadMode.DBT_LS`` fail when dbt outputs ``WarnErrorOptions`` by adammarples in 692
* Add support for env vars in ``RenderConfig`` for dbt ls parsing by jbandoro in 690
* Add support for Kubernetes ``on_warning_callback`` by david-mag in 673
* Fix ``ExecutionConfig.dbt_executable_path`` to use ``default_factory`` by jbandoro in 678

Others

* Docs fix: example DAG in the README and docs/index by tatiana in 705
* Docs improvement: highlight DAG examples in README by iancmoritz and jlaneve in 695

------------------

Bug fixes

* Store ``compiled_sql`` even when task fails by agreenburg in 671
* Refactor ``LoadMethod.LOCAL`` to use symlinks instead of copying directory by jbandoro in 660
* Fix 'Unable to find the dbt executable: dbt' error by tatiana in 666
* Fix installing deps when using ``profile_mapping`` & ``ExecutionMode.LOCAL`` by joppevos in 659

Others

* Docs: add execution config to MWAA code example by ugmuka in 674
* Docs: highlight DAG examples in docs by iancmoritz and jlaneve in 695