Skip to content

re_data - data quality framework. Build on top of dbt, re_data helps you find, debug and resolve problems in your data.

License

Notifications You must be signed in to change notification settings

patkearns10/re-data

 
 

Repository files navigation

Logo

Slack License Last commit

re_data

re_data is a data quality framework. It lets you do queries similar to those:

select * from anomalies_in_row_counts;

select * from recent_schema_changes;

select * from all_tables_freshness order by last_update_time;

select * from daily_null_percent where table = 'X' and col = 'Y';

in your Snowflake, Redshift, BigQuery, Postgres DB.

Build as dbt-package & optional python lib.

It lets you know what's happening in your data.

And you can visualize it, any way you want in your favorite BI tool.

Getting started

Check out docs 📔 📔

Source code

As dbt packages, currenlty need to be a seperate github repos - most of source code of re_data is here

Community

Join Slack for questions about using re_data and discussion with people making it 🙂

Integrations

We support almost all of the main data warehouses supported by dbt. We plan to add support for Spark (now officially supported by dbt).

Integration Status
BigQuerySupported
PostgreSQLSupported
RedshiftSupported
SnowflakeSupported
Apache SparkPlanned

License

re_data is licensed under the MIT license. See the LICENSE file for licensing information.

Contributing

We love all contributions 😍 bigger and smaller.

Check out the current list of issues here and see if you like anything from there. Also, feel welcome to join our Slack and suggest ideas or set up a live session here.

And if you got this far and like what we are building, support us! Star https://github.com/re-data/re-data on Github 🤩

About

re_data - data quality framework. Build on top of dbt, re_data helps you find, debug and resolve problems in your data.

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 67.3%
  • Shell 32.7%