Astronomer-providers

------------------

Bug Fixes
"""""""""

- Add poll interval to ``HttpSensorAsync``
(`554 <https://github.com/astronomer/astronomer-providers/pull/554>`_)
- Replace execution_timeout with timeout in all the async sensors
(`555 <https://github.com/astronomer/astronomer-providers/pull/555>`_)
- Get default 'resource_group_name' and 'factory_name' for
AzureDataFactoryPipelineRunStatusSensorAsync
(`589 <https://github.com/astronomer/astronomer-providers/pull/589>`_)

Enhancements
""""""""""""

- Add elaborate documentation and use cases for ``SnowflakeOperatorAsync``
(`556 <https://github.com/astronomer/astronomer-providers/pull/556>`_)
- Improve telemetry for Async Databricks Operators
(`582 <https://github.com/astronomer/astronomer-providers/pull/582>`_)
- Enhance ``S3KeySensorAsync`` to accept multiple keys and
deprecate ``S3PrefixSensorAsync`` and ``S3KeySizeSensorAsync``
(`577 <https://github.com/astronomer/astronomer-providers/pull/577>`_)

------------------

Bug Fixes
"""""""""

- Bump up ``MarkupSafe`` version as per Airflow 2.3.3 constraints
(`542 <https://github.com/astronomer/astronomer-providers/pull/542>`_)
- Downgrade ``Werkzeug`` version below 2.2.0 as it causes
``ImportError: cannot import name 'parse_rule' from 'werkzeug.routing'``
(`551 <https://github.com/astronomer/astronomer-providers/pull/551>`_)

------------------

New Operators
"""""""""""""

This release adds the following 4 new async sensors/operators:

.. list-table::
:header-rows: 1

* - Operator/Sensor Class
- Import Path
- Example DAG

* - ``BatchSensorAsync``
- .. code-block:: python

from astronomer.providers.amazon.aws.sensors.batch import BatchSensorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/amazon/aws/example_dags/example_batch.py>`__

* - ``SnowflakeSqlApiOperatorAsync``
- .. code-block:: python

from astronomer.providers.snowflake.operators.snowflake import SnowflakeSqlApiOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/snowflake/example_dags/example_snowflake_sql_api.py>`__

* - ``WasbBlobSensorAsync``
- .. code-block:: python

from astronomer.providers.microsoft.azure.sensors.wasb import WasbBlobSensorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/microsoft/azure/example_dags/example_wasb_sensors.py>`__

* - ``WasbPrefixSensorAsync``
- .. code-block:: python

from astronomer.providers.microsoft.azure.sensors.wasb import WasbPrefixSensorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/microsoft/azure/example_dags/example_wasb_sensors.py>`__


Enhancements
""""""""""""

- Add copy button to code blocks in docs
(`505 <https://github.com/astronomer/astronomer-providers/pull/505>`_)
- Add custom Sphinx extension to list available operators & sensors
(`504 <https://github.com/astronomer/astronomer-providers/pull/504>`_)
- Add pre-commit hook to check for dead links in markdown files
(`524 <https://github.com/astronomer/astronomer-providers/pull/524>`_)

------------------

New Operators
"""""""""""""

This release adds the following 5 new async sensors/operators:

.. list-table::
:header-rows: 1

* - Operator/Sensor Class
- Import Path
- Example DAG

* - ``DataprocCreateClusterOperatorAsync``
- .. code-block:: python

from astronomer.providers.google.cloud.operators.dataproc import DataprocCreateClusterOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/google/cloud/example_dags/example_dataproc.py>`__

* - ``DataprocDeleteClusterOperatorAsync``
- .. code-block:: python

from astronomer.providers.google.cloud.operators.dataproc import DataprocDeleteClusterOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/google/cloud/example_dags/example_dataproc.py>`__

* - ``DataprocUpdateClusterOperatorAsync``
- .. code-block:: python

from astronomer.providers.google.cloud.operators.dataproc import DataprocUpdateClusterOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/google/cloud/example_dags/example_dataproc.py>`__

* - ``RedshiftDataOperatorAsync``
- .. code-block:: python

from astronomer.providers.amazon.aws.operators.redshift_data import RedshiftDataOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/amazon/aws/example_dags/example_redshift_data.py>`__

* - ``RedshiftDeleteClusterOperatorAsync``
- .. code-block:: python

from astronomer.providers.amazon.aws.operators.redshift_cluster import RedshiftDeleteClusterOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/amazon/aws/example_dags/example_redshift_cluster_management.py>`__

Enhancements
""""""""""""

- Implement OpenLineage custom extractor for BigQuery Async Operators
(`429 <https://github.com/astronomer/astronomer-providers/pull/429>`_)
- Add session specific query tag and OpenLineage Extractor for Snowflake Async operator
(`437 <https://github.com/astronomer/astronomer-providers/pull/437>`_)
- Handle ``DataprocCreateClusterOperatorAsync`` errors gracefully and add additional
functionality with ``use_if_exists`` and ``delete_on_error`` parameters
(`448 <https://github.com/astronomer/astronomer-providers/pull/448>`_)

Bug Fixes
"""""""""

- Fix ``BigQueryInsertJobOperatorAsync`` failure after Google provider upgrade to 8.1.0
(`471 <https://github.com/astronomer/astronomer-providers/pull/471>`_)

------------------

This release adds the following 2 new async sensors/operators:

.. list-table::
:header-rows: 1

* - Operator/Sensor Class
- Import Path
- Example DAG

* - ``BatchOperatorAsync``
- .. code-block:: python

from astronomer.providers.amazon.aws.operators.batch import BatchOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/amazon/aws/example_dags/example_batch.py>`__

* - ``GKEStartPodOperatorAsync``
- .. code-block:: python

from astronomer.providers.google.cloud.operators.kubernetes_engine import GKEStartPodOperatorAsync
- `Example DAG <https://github.com/astronomer/astronomer-providers/blob/main/astronomer/providers/google/cloud/example_dags/example_kubernetes_engine.py>`__

Improvements
""""""""""""

* Enhance **KubernetesPodOperatorAsync** to periodically resume the sync portion of the task to fetch and
emit the latest logs before deferring again.
(`139 <https://github.com/astronomer/astronomer-providers/pull/139>`_)
* Fix a bug on the **KubernetesPodOperatorAsync** to not fail with ``ERROR - Unclosed client session``
(`394 <https://github.com/astronomer/astronomer-providers/pull/394>`_)

------------------

Enhancements
""""""""""""

- Enable Kerberos Authentication in ``HivePartitionSensorAsync`` and
``NamedHivePartitionSensorAsync``
(`357 <https://github.com/astronomer/astronomer-providers/pull/357>`_)


Bug Fixes
"""""""""

- Fix example Redshift DAGs to catch appropriate exception during cluster deletion
(`348 <https://github.com/astronomer/astronomer-providers/pull/348>`_)
- Move ``xcom_push`` call to ``execute`` method for all async operators
(`371 <https://github.com/astronomer/astronomer-providers/pull/371>`_)