New version of re_data implemented on top of dbt:
- start data quality project for your organisation
- compute metrics & anomalies for all tables in your data warehouse
- adjust what's monitored inside your database
- add more metrics to be collected inside your project
- add other data quality transformations based on our macros
v0.0.13-alfa
Detailed changes in milestone: https://github.com/redata-team/redata/milestone/1?closed=1
v0.0.12-alfa
Add support for running custom SQL checks - 58
Solves bugs - 64 65
Solves persistency for DB (adding volume for Redata DB)
Refactor in ui admin - split into separate files
Smaller UI improvements
v0.0.11-alfa
This release contains:
- fixes to logic choosing time column
- additional info in table details view (schema changes, alerts, last record insert)
- REDATA_TIME_COL_PREFERRED_REGEX parameter to specify which columns use for time
- some very simple error handing on scan (it should now show error if it fails not be stuck in pending)
- first version of documentation
v0.0.10-alfa
Snowflake, Redshift support it here!
Ability to compute and backfill metrics for past data
- you can choose dates for which scan will be run and with daily interval, this will backfill past data
Simple table details view in UI
- currently, it's possible to see, schema information there. We will be adding more features here in the future
v0.0.9-alfa
Redata UI is here!
Possibility to see & manage tables, checks, data_sources in UI
New checks run on tables (string lengths, missing values in columns)
Making checks faster by grouping checks into one query
v0.0.8-alfa
- support for backfill
- support for multiple schemas in DB
0.0.7-alfa
New features:
- First version of alerts
- Migration to timescale DB
- Pulumi deployment for AWS Fargate
v0.0.3-alfa
Support for PostgresSQL, BigQuery, Exasol, MySQL is here.