Released on 04-20-2023
- **(Breaking change) Default changed to not profile any model**: Profiling is a time-consuming operation. We have now changed the default to not profile any model, and users must manually add the `piperider` tag to the models.
- **AWS Athena Support**: Piperider now supports querying data stored in AWS Athena.
- **Skipped model reasons**: We have added the ability to display the reason why certain models were skipped during profiling and metric queries, making it easier for users to understand and improve their data pipeline.
- **Compare Recipe Enhancements**: Our Compare recipe has been enhanced to support both file and Jinja formats, allowing users to template values from environment variables for more dynamic comparisons.
- **Other Enhancements and Bug Fixes**: We have also made several other enhancements and bug fixes, including the addition of buttons for GitHub, Discord, and documentation feedback, ensuring users have an easy and efficient way to provide feedback and suggestions for future improvements.
Breaking Change
In this update, we have changed the default logic for `piperider run` on dbt projects. Previously, we would profile all table models by default, but now we will not profile any model by default. You will need to set the models with a `piperider` tag for us to profile them.
Scope of impact:
1. Existing projects will not be affected because we have only changed the default value for project config init.
Previous default value
bash
dataSources: []
dbt:
projectDir: .
tag: 'piperider'
Current default value:
bash
dataSources: []
dbt:
projectDir: .
tag: 'piperider'
You can still comment out the `tag` field, and the behavior will be the same as before.
2. Newly initialized dbt projects will be changed to profile the model with `piperider` tag.
3. Non-dbt projects will not be affected.
Get in touch :heart:
We'd love your feedback! Send us a message via Intercom on [piperider.io](https://piperider.io), join our [Discord](https://discord.gg/xKxsdPx4d5), report an issue on [GitHub](https://github.com/InfuseAI/piperider/issues), or send us a good old-fashioned [email](mailto:productinfuseai.io)
----
<details>
<summary>All changes</summary>
What's Changed
* [Release] Bump version 0.23.0 by wcchang1115 in https://github.com/InfuseAI/piperider/pull/653
* [Feature] Support AWS Athena by popcornylu in https://github.com/InfuseAI/piperider/pull/652
* [Feature] Show filter logic for profiling and metric queries by wcchang1115 in https://github.com/InfuseAI/piperider/pull/651
* [Feature] Output absolute report path when piperider run by wcchang1115 in https://github.com/InfuseAI/piperider/pull/654
* [Feature] Support file and jinja format for compare recipe by wcchang1115 in https://github.com/InfuseAI/piperider/pull/656
* [Feature] Show empty block for missing table/column in the report by popcornylu in https://github.com/InfuseAI/piperider/pull/660
* [Feature] Enable piperider tag by default for dbt project by ctiml in https://github.com/InfuseAI/piperider/pull/662
* [Document] Update README for athena connector by popcornylu in https://github.com/InfuseAI/piperider/pull/661
* [Chore] Receive return code from uploading report by ctiml in https://github.com/InfuseAI/piperider/pull/655
* [Bug] add buttons for GitHub discord docs feedback by popcornylu in https://github.com/InfuseAI/piperider/pull/657
* [Bug] Support reading jinja format in dbt project yaml by wcchang1115 in https://github.com/InfuseAI/piperider/pull/658
* [Bug] Fold uploaded report url when it's larger than available space by wcchang1115 in https://github.com/InfuseAI/piperider/pull/659
**Full Changelog**: https://github.com/InfuseAI/piperider/compare/v0.22.0...v0.23.0
</details>