Dbt-databricks

Fixes

- Undo the removal of spark.sql.sources.partitionOverwriteMode = DYNAMIC ([688](https://github.com/databricks/dbt-databricks/pull/688))
- Set spark.sql.sources.partitionOverwriteMode = STATIC on --full-refresh to ensure existing rows are removed ([697](https://github.com/databricks/dbt-databricks/pull/697))
- Migrate to using system.information_schema to fix issue with catalog renames ([692](https://github.com/databricks/dbt-databricks/pull/692))
- Cancel python jobs when dbt operation is canceled (thanks gaoshihang for kicking this off!) ([693](https://github.com/databricks/dbt-databricks/pull/693))
- Fix the default redirect_url and scopes of the client `dbt-databricks` ([704](https://github.com/databricks/dbt-databricks/pull/704))

Under the Hood

- Reduce severity of logging when expected 24 hour token expiration for Azure SPA (thanks thijs-nijhuis!) ([699](https://github.com/databricks/dbt-databricks/pull/699))
- Migrate remaining unit tests off of unittest.TestCase ([701](https://github.com/databricks/dbt-databricks/pull/701))

Features

- Support Liquid Clustering for python models ([663](https://github.com/databricks/dbt-databricks/pull/663))
- Update Liquid Clustering columns on is_incremental runs ([686](https://github.com/databricks/dbt-databricks/pull/686))

Fixes

- Rerunning seed with external location + persist_doc now more resilient ([662](https://github.com/databricks/dbt-databricks/pull/662))
- Fix issue with running while a refresh is in progress with MV/ST ([674](https://github.com/databricks/dbt-databricks/pull/674))
- Fix issue with running a refresh with MV/ST that need names to be escaped ([674](https://github.com/databricks/dbt-databricks/pull/674))

Under the Hood

- Delay loading of agate library to improve startup (thanks dwreeves for getting this started!) ([661](https://github.com/databricks/dbt-databricks/pull/661))
- Updating to dbt-adapters~=1.2.0 ([683](https://github.com/databricks/dbt-databricks/pull/683))

Features

- Support `on_config_change` for materialized views, expand the supported config options ([536](https://github.com/databricks/dbt-databricks/pull/536)))
- Support `on_config_change` for streaming tables, expand the supported config options ([569](https://github.com/databricks/dbt-databricks/pull/569)))
- Support Databricks tags for tables/views/incrementals ([631](https://github.com/databricks/dbt-databricks/pull/631))

Under the Hood

- Upgrade databricks-sql-connector to 3.1.0 ([593](https://github.com/databricks/dbt-databricks/pull/593))
- Migrate to decoupled architecture ([596](https://github.com/databricks/dbt-databricks/pull/596))
- Finish migrating integration tests ([623](https://github.com/databricks/dbt-databricks/pull/623))
- Streamline the process of determining materialization types ([655](https://github.com/databricks/dbt-databricks/pull/655))
- Improve catalog performance by getting column description from project for UC ([658](https://github.com/databricks/dbt-databricks/pull/658))

Fixes

- Fix the issue that 1.7.15 was intended to fix (conn not initialized exception) ([671](https://github.com/databricks/dbt-databricks/pull/671))

Fixes

- Give sensible logs when connection errors ([666](https://github.com/databricks/dbt-databricks/pull/666))

Fixes

- Auth headers should now evaluate at call time ([648](https://github.com/databricks/dbt-databricks/pull/648))
- User-configurable OAuth Scopes (currently limited to AWS) (thanks stevenayers!) ([641](https://github.com/databricks/dbt-databricks/pull/641))

Under the hood

- Reduce default idle limit for connection reuse to 60s and start organizing event logging ([648](https://github.com/databricks/dbt-databricks/pull/648))