:sparkles: Features * Drop schemas for expired environments (1177) eakmanrq * Support the '_dbt_max_partition' variable for BigQuery dbt projects (1195) izeigerman
:beetle: Bug fixes * Use session when creating snapshot tables (1190) izeigerman * Support insert overwrite with dynamic partitions in the BigQuery adapter (1188) izeigerman * Fix test (1193) eakmanrq * Add boolean to fix request params type (1199) mykalmax * Set forward_only to true by default for the Incremental Unmanaged model kind (1200) izeigerman * Fix invalidating env test (1201) eakmanrq * Make sure the evaluation progress bar looks good when evaluating a large number of models (1202) izeigerman
:broom: Chore * Rename 'target_partitions' variable to something more distinct to avoid potential conflict izeigerman
:alien: Other * Support both import paths for exceptions (1194) eakmanrq * Update docs with default dialect specification (1196) treysp * Introduce the model test API endpoint (1198) vchan
0.21.0
:sparkles: Features * Introduce an additional 'incremental_unmanaged' model kind to support existing incremental mode in dbt projects (1173) izeigerman * Support sessions in the BigQuery adapter (1185) izeigerman
:beetle: Bug fixes * Fix styling for cli reference init (1184) treysp * Deserialization of the incremental unmanaged model kind izeigerman * Remove SQL dialect config for dbt projects (1189) treysp
0.20.0
:sparkles: Features * Require dialect arg in sqlmesh config (1127) treysp * Add endpoint to get current version + display version in footer (1174) mykalmax
:beetle: Bug fixes * Tab not showing after refresh + store unsaved changes (1164) mykalmax * Quote all identifiers in execute except those coming from fetchdf (1128) GeorgeSittas * Skip directories in a dbt project that the user is not permitted to access (1179) crericha * Make postgres keepalives_idle optional for dbt projects (1180) crericha * Make dbt postgresql targeting read database name from profile correctly lu0x1a0
:hammer_and_wrench: Refactor * Replace snapshot model with snapshot node (1137) crericha
:alien: Other * Reorder cli quickstart (1168) treysp * Return an empty array of columns instead of an error when columns_to_types is None (1169) vchan * Reorder notebook quickstart (1170) treysp * Add dbt adapter link to install page (1176) treysp * Remove extra check mark (1182) treysp * Revert "Remove extra check mark (1182)" (1183) treysp
0.19.0
:beetle: Bug fixes * Normalize model name, issue for dbt snowflake tobymao * Fix Windows faulthandler and seed path (1162) eakmanrq * Allow reverting to previous versions (1163) eakmanrq * Json bigquery types show up as TYPE_KIND_UNSPECIFIED tobymao
:broom: Chore * Rename --promote-all to --include-unmodified (1166) izeigerman
0.18.0
:sparkles: Features * Improve file explorer (1044) mykalmax * Promote only changed snapshots in dev environments (1131) izeigerman * Show scrollbar on hover for all scrollable blocks (1141) mykalmax * Add support for forward_only and disable_restatement flags to incremental models (1144) izeigerman * Add sorting/filtering to table (1138) mykalmax * Improve consistent styling for inputs + use radix/select for selectors (1151) mykalmax * Prettier Slack webhook notifications (1145) z3z1ma * Add keyboard support to the SearchList component (1143) mykalmax * Determine time_column from bigquery partition_by config (1153) crericha * Add ttl to snapshot cache (1158) tobymao * Add progress bar for snapshot creation (1157) GeorgeSittas * Re-use ModelConfirmation component from IDE page (1155) mykalmax
:beetle: Bug fixes * Properly support DataFrames when doing INCREMENTAL_BY_UNIQUE_KEY (1119) eakmanrq * Normalize model names and dependencies as sqlglot dialect (1126) tobymao * Populate unittest inputs before rendering query, which may access the input tables (1121) crericha * Improve SQL syntax in editor (1095) mykalmax * Migration for view models (1124) izeigerman * Databricks session_configuration can be None (1129) eakmanrq * Allow forward-only on added external models (1130) eakmanrq * Allow partials when loading configs + Personal Config Overrides Project (1136) eakmanrq * Manually check if sqlglot ready when loading Editor component (1142) mykalmax * Display compiled query in model docs (1149) mykalmax * Re-introduce the 'sqlmesh' jinja flag for dbt projects izeigerman * Skip auto categorization for snapshots that indirectly modify models with missing schema (1147) izeigerman * Failing tests izeigerman * Unique type discriminator for GCPPostgresConnectionConfig (1152) crericha * Only migrate snapshots that are paused (1154) izeigerman * Missing intervals should not include indirect non breaking tobymao * Fix windows paths for executables (1156) eakmanrq * Update the Airflow integration test izeigerman * Create_external_models refetch existing external models closes 1132 tobymao * File disappear after dragging + add long press to enable dragging (1159) mykalmax * Correctly handle missing intervals for forward-only snapshtos when effective_from is set (1160) izeigerman * Fix the total number of tasks for the snapshot creation progress bar (1161) izeigerman
:hammer_and_wrench: Refactor * Make sqlmesh incremental blocks more clear (1140) crericha * Remove hydrating and missing_intervals from state_sync (1116) tobymao * Make scheduler explicitly take SnapshotIdLike since it refetches from state_sync tobymao
:broom: Chore * Bump sqlglot to v17.3.0 (1111) GeorgeSittas * Add type so eslint understands when value is exists (1092) mykalmax * Updated packages (1134) mykalmax
:alien: Other * No longer retry bad request (1118) eakmanrq * Add connection configuration to quickstart next steps (1125) treysp * Update built-in scheduler description (1123) treysp * Add connection config for GCP managed Postgres (1146) crericha * Add promote_all option (1148) mykalmax
0.17.0
:sparkles: Features * Add tranpile option to format (1057) z3z1ma * Use dialect when (de)serializing model expressions (1027) GeorgeSittas * Add Snowflake authenticator connection config for dbt projects. (1066) crericha * Add more builtin audits (1051) z3z1ma * Pass 2 of more useful builtin audits (1068) z3z1ma * Code editor enhancement (1019) mykalmax * Enhance notification target functionality (944) vchan * Add tags support for dbt projects. (1087) crericha * Add a state sync cache for performance tobymao * Add progress bar for migrations (1102) GeorgeSittas
:beetle: Bug fixes * Use correct quote policy in dbt projects. Create correct relation instances in the adapter (1058) izeigerman * More bigquery table api issues (1059) tobymao * Parse cluster_by in dbt models before converting to SQLMesh models (1060) izeigerman * Map relations to snapshot physical tables in the dbt adapter (1064) izeigerman * Bigquery catalog ast tobymao * Prevent creation of schema for symbolic models (1061) izeigerman * Always set global variables for dbt packages. Manually extract macro references in additional to the ones fetched from the manifest (1069) izeigerman * Support int64 range partitioning for BQ dbt projects (1070) izeigerman * Allow multiple statements after rendering jinja for pre- / post-statements (1072) izeigerman * Handle optional model and audit paths in the API (1071) vchan * Propagate table properties when replacing query (1076) izeigerman * Make sure to skip a node only once when concurrently processing a DAG (1079) izeigerman * Support legacy property names in the dbt BQ target (1080) izeigerman * Fallback to model dialect when rendering an audit query (1081) izeigerman * Support dbt_utils.star prefix and suffix using dbt version of the macro (1085) crericha * Fetch columns-to-types mapping from the target DW when determining a type of the time column (1083) izeigerman * Make all BigQuery db calls retryable (1084) eakmanrq * Deterministic order when computing fingerprint for jinja macro packages (1088) izeigerman * Fix bigquery nested types (1089) tobymao * Update views only for snapshots that are new to the target environment. Close state sync connections properly (1093) izeigerman * **(docs)** Fix integration docs links tobymao * Circular ref debug_mode tobymao * Handle corrupt snapshots due to upgrades closes 1063 (1091) tobymao * Support older versions of BigQuery python library (1096) izeigerman * Preserve the model query cache after fetching snapshots from state sync (1098) izeigerman * Cli failure due to missing package (1099) z3z1ma * Include database in dbt source fqns when it differs from the project's database (1101) crericha * Logging import in CLI izeigerman * Jinja rendering comments (1105) tobymao * Remove redundant get_snapshots call when promoting to a dev environments (1107) izeigerman * Determine duckdb database from db filename if not specified. (1106) crericha * Duckdb default catalog name is main for dbt version < 1.5. (1109) crericha * Use schema for table diff summary table (1112) izeigerman * Snapshot intervals erroneously classified as dev (1113) izeigerman * Invalid AST when constructing BQ parition by expressions for dbt models (1114) izeigerman * The skip-tests flag in CLI izeigerman * Treat end date as inclusive only for models with a daily cadency (1115) izeigerman
:hammer_and_wrench: Refactor * Macro reference extraction doesn't need dialect specific sql. using generic for performance (1067) tobymao
:broom: Chore * Polish up chi square test and allow auditing for dependence OR independence (1073) z3z1ma * Upgrade sqlglot to v17 (1090) tobymao * Update table diff styling and expand tests (1077) treysp * Remove noisy warnings izeigerman * Add ability to ignore warning messages in CLI izeigerman * Bumpt sqlglot version to 17.2.0 (1108) izeigerman
:alien: Other * Correct deleted model output in models guide (1062) treysp * Auto rollback migration if it fails (1075) tobymao * Enforce dynamic ins/over and make db ins/over (1074) eakmanrq * Add link to Python API reference (1082) treysp * Add table diff guide (1078) treysp * Add new built-in audits to audits guide (1094) treysp * Revert "Feat: add a state sync cache for performance" tobymao * Add details for bigquery connection (1097) adrianbr * Add type discriminator to notification targets (1103) vchan * Revert "Revert "Feat: add a state sync cache for performance"" (1104) tobymao * Add notification documentation (1086) vchan * Replace NaN with None in tests (1110) vchan * Add table diff guide to mkdocs (1117) treysp