Databand

New features

- \1200535318342009: Databand Alerting now supports email as a notification channel.
- \1200401288822416: Per Project and Source Alert routing - you can define Alerts on any job as you like.
- \1200443526055542: New Run duration metrics: Duration, Total Duration, Compute Time.
- \1200596368463950: New alert type: get notifications when a schema changes on the data you logged with `log_dataset_op`.

Improvements

- \1200535433472848: Dashboard widgets now show the project or source name if there are multiple sources. This addresses the case of a pipeline with the same name coming from 2 sources.
- \1200587432732540: Look at the affected datasets of past Runs by clicking on Runs.
- \1200557294252243: New tooltip added to the Dataset overview chart - you now can display the Run status and add/view label.
- \1200602972144983: Dataset overview chart changed from stacked to a regular graph.
- \1200526324086040: New alert type: when using `log_dataset_op`, you can get notifications when a pipeline didn’t read or write as expected.
- \1200430856087576: Alerts can now be set directly from the Alerts page.
- \1200557294252244: Missing operations are now prominently displayed in the history chart and in the Trend operation bars graph.
- \1200557294252253: Improved coloring for better readability of dataset graphs.

Bug fixes

- \1200587833068258: The description in the alert pop-up is no longer missing.
- \1200587301890745: Datasets page sorting and filtering are fixed - dataset operations are sorted by most recent first.
- \1200557970734951: Current Run is marked as usual.
- \1200579848765971: Datasets page filters project correctly.

New features

- \1200404227512965: Choose and view any suitable metric in a new chart in the Favorite Metric widget.
- \1200369882031623: View Run's data operations (writes, schema, etc.) in the Run with alerts and see what happened in the last 6 Runs.
- \1200526450615526: Helm chart variables now support Global image configs.

Improvements

- \1200526450615534: Improved performance of Databand Web UI configuration. AS-1200371843828304 Errors from Airflow are now displayed in the Run list.
- \1200463339266254: An extensive round of improvements of the metrics reporting and display processes.
- \1200258862047040: Access to custom metrics is now available. Reporting metrics and discovering what metrics are reported within Databand got much easier.
- \1199332360687562: [Breaking change!] Deprecated `__execute` tasks and separation for root-Run and sub-Runs per Airflow task. All the information which was previously reported on `<task_name>__execute task` (like metrics or log) is now reported on `<task_name> task`.
- \1200483852764557: The `log_dataset_op` behavior is now the same for `read` and `write`.
- \1200445773961847: `log_dataset_op` can have the `log_df` functionality.

New features

- \1200445773961849: Introducing `log_dataset_op` - now you can manually log the dataset you are interacting with.
- \1200130408884030: Outside-of-the-box tracking support for PySpark with Databricks.
- \1199370081934662: Added Live Logs for Kubernetes workers in the Airflow UI.
- \1200401140575119: Missing Data now triggers an alert.
- \1200454655158822: Now you can calculate metric aggregations like SUM/AVG and others and display them in the Favorite charts widget. You can also compare trends over the filtered time period and display trends.
- \1200430623687636: Dataset Screen is deprecated and replaced by Data Targets and Datasets screen in the UI.
- \1200466625626565: Added support for custom headers for Alert Manager webhooks.

Improvements

- \1200403795815183: Improved Favorite Metric widget usability.
- \1200463339266254: Improved Metric tab interface.
- \1200452512156534: ‘Triggered by column’ is removed from the Run list.
- \1200408168252754: History tab is removed from the Run details.
- \1200430599620006: Timeline Tab in the Run details is deprecated.
- \1200181993522176: Proper support for DagRun submit args and XCom; values are reported with correct types.
- \1200275295497774: Added support for the Airflow retries and restarts in Alerts.
- \1200372371285197: It’s now possible to expose Run env and user in the `stats_api` for alerting.

Bug fixes

- \1200402990123287: Fixed a bug that prevented proper tracking from Databricks.
- \1200358546721956: Metrics that cannot be presented in a graph now cannot be added.
- \1200275951379648: Fixed incorrect handling of attempts.
- \1200440061411916: Fixed tracking tasks from `task`.
- \1200035644894886: Fixed browser ‘Back’ button behavior in the Run details page.
- \1200503204031963: Fixed bug that prevented to define advanced alert
- \1200542429205442: Fixed support for airflow_local_settings in auto-tracking

New features

- \1200378732521423: Airflow Monitor v2 now supports Airflow 2.0.
- \1200392175180332: The Favorite Metric widget in the Dashboard now automatically displays anomalies for metrics.
- \1200213466288282: Now supporting Google Composer for Airflow tracking.
- \1200340430085787: Main menu now expands to include titles.
- \1200321463111129: Added a chart display toggle for switching between Run charts in the Favorite Metric widget.
- \1200095672805698: Users can select the main page view. The default mode is Dashboard; options: Dashboard or Pipelines.
- \1200309661632765: The Syncer page was moved to the Settings page.
- \1200284286454068: Now you can identify errors in different Runs - both the error message and the error type now lead to the Run page; the task that triggered the error is selected so you can view the error.
​

Improvements

- \1200403425760171: Added new Syncer issue counters in the Settings section.
- \1200420269065898: Only the table is now scrollable in the Metrics widget.
- \1200400792119627: Changes in the chart type design.
- \1200400792119629: Changes in the Dashboard chart tooltips - now, the nearest point tooltip will be displayed.
- \1200251794221201: Improved the readability of the metric charts tooltip.
- \1200378661150501: Added Error Column to All Runs and Pipeline Runs lists.
- \1200369692119674: Improved usability of the Alert Definition section.
- \1200374990956464: Tasks in Airflow sub-processes are now automatically assigned unique names.
- \1200102937873725: Added a unified context manager for handling log dataset operations.
- \1200279378863216: Aligned and improved alert counters in the Pipeline and Run lists.
​

Bug fixes

- \1200401407223048: Fixed custom date picker behavior and placed it next to the Pipeline filter.
- \1200126969897499: Task ID is now correctly displayed in the UI.

New features

- \1200253837838312: Added Deequ + PySpark integration.
- \1200245988366766: Added multiple metrics support in the Favorite Metric widget.
- \1200095672805698: Home Screen selection option is now available in the Settings Page.
- \1200306047670389: It’s now possible to enable the debug mode in PyDev from the CLI.
- \1200179220565213: Slack notifications can now be received from the Databand UI.

Improvements

- \1199965369989833: Tracking is now compatible with Airflow 2.0.
- \1200213466288282: Airflow tracking is running on Google Composer.
- \1200105822969991: Added support for liveness probe check in Airflow Monitor v2.0.
- \1200327639593933: Latest Pandas version (1.2.x) is now supported.
- \1200223284217045: Improved Alert screen.
- \1200345876827058: Alert rules can be enabled based on the Run env.
- \1200269646547649: “Last Active” widget moved to the bottom of the screen.
- \1200269646547644: Pipeline screen's default view is set to “List”.
- \1200310831229608: PyWheel build tasks are not displayed in the UI now.
- \1200315872631815: Changed the cursor in Favorite Charts.

Bug fixes

- \1200305391366264: Fixed missing filters and Run names in the Alert API.
- \1200324498682162: Identified and fixed the issue with Sentry integration.
- \1200275951379648: Fixed incorrect handling of attempts.
- \1200290917819476: Changed Error Widget headline to “Top Errors”.
- \1200359124635729: Fixed error on wrong outputs’ schema in Orchestration.

New features

- \1200183306770565: Stats widget changed to display the top failure rate Pipelines.
- \1200191541441378: Server-side sorting for Pipeline stats widget.
- \1200258224502988: New Anomaly Detection alert is triggered if Custom Metric grows too fast.
- \1200259328525645: Airflow Monitor v.2.
- \1200183150156169: It’s now possible to see an alert’s effect on the affected data.

Improvements

- \1200044288700180: Drill down to Runs & Pipelines from the Dashboard.
- \1200259770331112: Click iteration and reporting stats added to Dashboard.
- \1200058439151159: Airflow monitor heartbeat indication.
- \1200243606518228: Errors Discovery Flow added for non-Python Operators.

Bug fixes

- \1200276060368190: Negative values are now displayed in Dashboard charts.
- \1200285224722668: Fixed Docker version incompatibility issue (extended the number of supported versions).
- \1200275951379659: Fixed Kubernetes execution bug when tasks were wrongly marked as canceled on the end of Pipelines.