Piperider

Latest version: v0.41.0

Safety actively analyzes 638418 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 20 of 26

0.10.0rc.1

What's Changed
* [Release] Bump version to 0.10.0 by wcchang1115 in https://github.com/InfuseAI/piperider/pull/439
* [Feature] - library + no table details + page enhancements by jonycfu in https://github.com/InfuseAI/piperider/pull/438
* [Feature] Remove default value of descriptions by wcchang1115 in https://github.com/InfuseAI/piperider/pull/432
* [Feature] Support snowflake authenticator configuration by wcchang1115 in https://github.com/InfuseAI/piperider/pull/459
* [Feature] Add table duplicate rows profiling by wcchang1115 in https://github.com/InfuseAI/piperider/pull/444
* [Feature] sc 28170 - support duplicate rows profiler UI by jonycfu in https://github.com/InfuseAI/piperider/pull/460
* [Feature] Return exit code = 2 if test failed by popcornylu in https://github.com/InfuseAI/piperider/pull/462
* [Document] Fix link for data sources on README by hlb in https://github.com/InfuseAI/piperider/pull/442
* [Document] Readme remove GIFS by jenswilms in https://github.com/InfuseAI/piperider/pull/443
* [Bug] Change symlink of latest folder of reports by wcchang1115 in https://github.com/InfuseAI/piperider/pull/461


**Full Changelog**: https://github.com/InfuseAI/piperider/compare/v0.9.0...v0.10.0-rc.1

0.9.0

Released on 09-22-2022
PipeRider version 0.9.0 is out now! We added volume & freshness metrics, and you can now customized the tables and row count you want to profile!


:chart_with_upwards_trend: Added volume & freshness metrics
See volume size of your table, when created, and when last update:
- Snowflake: Volume size, Created time, Last altered time
- BigQuery: Volume size, Created time, Last altered time
- Redshift: Volume size

[See full overview of supported metrics](https://github.com/InfuseAI/piperider/blob/main/docs/metrics.md#table-metrics)

:file_folder: Include or exclude tables in config
Now, you can specify the tables to include or exclude in a project

1. Edit the configuration file under `.piperider/config.yml`
2. Add the following config

yaml
config.yml

includes: ["table1", "table2", "table3"]

or tables to exclude
excludes: ["table4"]


:zap: Do a speedrun by limiting the amount of rows

You can now set a limit* on the rows to profile, so you can do a quick run on large datasets.

1. Edit the configuration file under `.piperider/config.yml`
2. Add the following config

yaml
config.yml

profiler:
table:
the maximum row count to profile. (Default unlimited)
limit: 1000000


**Keep in mind: setting the row limit will pick the first n rows of your table. The behavior of the limit is the same as the keyword limit in SQL*


New Contributors
* jenswilms made their first contribution in https://github.com/InfuseAI/piperider/pull/427

Get in touch :heart:

We'd love your feedback! Send us a message via Intercom on [piperider.io](https://piperider.io), join our [Discord](https://discord.gg/xKxsdPx4d5), report an issue on [GitHub](https://github.com/InfuseAI/piperider/issues), or send us a good old-fashioned [email](mailto:productinfuseai.io)



----


<details>
<summary>All changes</summary>


* [Release] Bump version to 0.9.0 by kentwelcome in https://github.com/InfuseAI/piperider/pull/423
* [Feature] simple breadcrumb nav 2 by jonycfu in https://github.com/InfuseAI/piperider/pull/424
* [Feature] sc-28513 Show progress when loading large CSV or parquet file by kentwelcome in https://github.com/InfuseAI/piperider/pull/426
* [Feature] - sc 28379/UI add table metadata info by jonycfu in https://github.com/InfuseAI/piperider/pull/428
* [Feature] Add table profiling rows limit by wcchang1115 in https://github.com/InfuseAI/piperider/pull/429
* [Feature] Apply includes and excludes config to profiler by wcchang1115 in https://github.com/InfuseAI/piperider/pull/430
* [Feature] upload report command by qrtt1 in https://github.com/InfuseAI/piperider/pull/408
* [Document] Update README.md by jenswilms in https://github.com/InfuseAI/piperider/pull/427
* [Document] Update readme data profiling by jenswilms in https://github.com/InfuseAI/piperider/pull/435
* [Chore] assertion labels by neighborhood999 in https://github.com/InfuseAI/piperider/pull/420
* [Chore] Feature/sc 28380 - Prepare UI Library Components by jonycfu in https://github.com/InfuseAI/piperider/pull/410
* [Chore] Enhance piperider init flow by wcchang1115 in https://github.com/InfuseAI/piperider/pull/409
* [Bug] table schema overflow by neighborhood999 in https://github.com/InfuseAI/piperider/pull/425
* [Bug] Fix the overflow issue for the `sum` metric by popcornylu in https://github.com/InfuseAI/piperider/pull/433
* [Bug] Use built-in stddev in all data sources except sqlite by wcchang1115 in https://github.com/InfuseAI/piperider/pull/431
* [Bug] In piperider init, merge the credential only in non-dbt project by popcornylu in https://github.com/InfuseAI/piperider/pull/434

**Full Changelog**: https://github.com/InfuseAI/piperider/compare/v0.8.0...v0.9.0

</details>

0.9.0rc.1

What's Changed
* [Release] Bump version to 0.9.0 by kentwelcome in https://github.com/InfuseAI/piperider/pull/423
* [Feature] simple breadcrumb nav 2 by jonycfu in https://github.com/InfuseAI/piperider/pull/424
* [Feature] sc-28513 Show progress when loading large CSV or parquet file by kentwelcome in https://github.com/InfuseAI/piperider/pull/426
* [Feature] - sc 28379/UI add table metadata info by jonycfu in https://github.com/InfuseAI/piperider/pull/428
* [Feature] Add table profiling rows limit by wcchang1115 in https://github.com/InfuseAI/piperider/pull/429
* [Feature] Apply includes and excludes config to profiler by wcchang1115 in https://github.com/InfuseAI/piperider/pull/430
* [Feature] upload report command by qrtt1 in https://github.com/InfuseAI/piperider/pull/408
* [Document] Update README.md by jenswilms in https://github.com/InfuseAI/piperider/pull/427
* [Chore] assertion labels by neighborhood999 in https://github.com/InfuseAI/piperider/pull/420
* [Chore] Feature/sc 28380 - Prepare UI Library Components by jonycfu in https://github.com/InfuseAI/piperider/pull/410
* [Chore] Enhance piperider init flow by wcchang1115 in https://github.com/InfuseAI/piperider/pull/409
* [Bug] table schema overflow by neighborhood999 in https://github.com/InfuseAI/piperider/pull/425
* [Bug] Fix the overflow issue for the `sum` metric by popcornylu in https://github.com/InfuseAI/piperider/pull/433
* [Bug] Use built-in stddev in all data sources except sqlite by wcchang1115 in https://github.com/InfuseAI/piperider/pull/431
* [Bug] In piperider init, merge the credential only in non-dbt project by popcornylu in https://github.com/InfuseAI/piperider/pull/434

New Contributors
* jenswilms made their first contribution in https://github.com/InfuseAI/piperider/pull/427

**Full Changelog**: https://github.com/InfuseAI/piperider/compare/v0.8.0...v0.9.0-rc.1

0.8.0

Released on 09-08-2022
PipeRider version 0.8.0 is out now! We got a brand new interface, and added support for CSV and Parquet!



:rocket: Our HTML reports got a brand new upgrade
* Added a new report overview page so you can view your data's health within seconds
* Every table page includes the run PipeRider (and dbt) tests and key metrics
* Click on a column, and the page will expand and show in-depth metrics about the specific column

![](https://i.imgur.com/IdynzGt.png)

See it for yourself: `piperider run`

:file_folder: New datasources: CSV, Apache Parquet, and DuckDB
In addition to Snowflake, Sqlite, and Postgres, you can now use piperider on CSV, apache Parquet, and duckdb files!

[Integrate your data source and get started](https://docs.piperider.io/data-sources/supported-data-sources)


Get in touch :heart:

We'd love your feedback! Send us a message on [piperider.io](https://piperider.io), join our [Discord](https://discord.gg/xKxsdPx4d5), or report an issue on [GitHub](https://github.com/InfuseAI/piperider/issues)



----


<details>
<summary>All changes</summary>


* [Feature] Refine the initialization flow for BigQuery by qrtt1 in https://github.com/InfuseAI/piperider/pull/382
* [Feature] single & comparison list overview by neighborhood999 in https://github.com/InfuseAI/piperider/pull/377
* [Feature] sc-27803 Support CSV datasource by duckdb by kentwelcome in https://github.com/InfuseAI/piperider/pull/388
* [Feature] enhance column profiling performance by multithread by wcchang1115 in https://github.com/InfuseAI/piperider/pull/394
* [Feature] Remove descriptions from assertion files by wcchang1115 in https://github.com/InfuseAI/piperider/pull/396
* [Feature] applied table overview with new design by neighborhood999 in https://github.com/InfuseAI/piperider/pull/397
* [Feature] extract metadata of cloud data warehouse by wcchang1115 in https://github.com/InfuseAI/piperider/pull/390
* [Feature] column detail page (sc 27971) by jonycfu in https://github.com/InfuseAI/piperider/pull/399
* [Feature] sc-27803 Add pip intstall piperider[csv] & piperider[parquet] by kentwelcome in https://github.com/InfuseAI/piperider/pull/404
* [Bug] iterate table.columns instead of assertions to display columns by neighborhood999 in https://github.com/InfuseAI/piperider/pull/391
* [Bug] check base & target is undefined/null and fixed types by neighborhood999 in https://github.com/InfuseAI/piperider/pull/393
* [Bug] sc-28278 Encoded the json payload and decoded them in index.html by kentwelcome in https://github.com/InfuseAI/piperider/pull/395
* [Bug] readme (issue 392) by jonycfu in https://github.com/InfuseAI/piperider/pull/403
* [Bug] Remove snowflake-sqlalchemy dependency by wcchang1115 in https://github.com/InfuseAI/piperider/pull/405
* [Bug] apply label text max content by neighborhood999 in https://github.com/InfuseAI/piperider/pull/407
* [Bug] : forgot decode params (master-list-item) by jonycfu in https://github.com/InfuseAI/piperider/pull/412
* [Bug] Fix custom assertion exception when falsy actual field given by wcchang1115 in https://github.com/InfuseAI/piperider/pull/413
* [Bug] : add props events to propogate state for tab-index reset (Chakra … by jonycfu in https://github.com/InfuseAI/piperider/pull/416
* [Bug] sc-28422 detect csv file encoding and provide suggest ations by kentwelcome in https://github.com/InfuseAI/piperider/pull/415
* [Bug] add default values to assertions check by neighborhood999 in https://github.com/InfuseAI/piperider/pull/419
* [Release] sc-28246 Bump PipeRider version and update sample reports by kentwelcome in https://github.com/InfuseAI/piperider/pull/387
* [Chore] Compact json of piperider run result by wcchang1115 in https://github.com/InfuseAI/piperider/pull/406

**Full Changelog**: https://github.com/InfuseAI/piperider/compare/v0.7.0...v0.8.0

</details>

0.8.0rc2

What's Changed
* [Feature] Refine the initialization flow for BigQuery by qrtt1 in https://github.com/InfuseAI/piperider/pull/382
* [Feature] single & comparison list overview by neighborhood999 in https://github.com/InfuseAI/piperider/pull/377
* [Feature] sc-27803 Support CSV datasource by duckdb by kentwelcome in https://github.com/InfuseAI/piperider/pull/388
* [Feature] enhance column profiling performance by multithread by wcchang1115 in https://github.com/InfuseAI/piperider/pull/394
* [Feature] Remove descriptions from assertion files by wcchang1115 in https://github.com/InfuseAI/piperider/pull/396
* [Feature] applied table overview with new design by neighborhood999 in https://github.com/InfuseAI/piperider/pull/397
* [Feature] extract metadata of cloud data warehouse by wcchang1115 in https://github.com/InfuseAI/piperider/pull/390
* [Feature] column detail page (sc 27971) by jonycfu in https://github.com/InfuseAI/piperider/pull/399
* [Feature] sc-27803 Add pip intstall piperider[csv] & piperider[parquet] by kentwelcome in https://github.com/InfuseAI/piperider/pull/404
* [Bug] apply label text max content by neighborhood999 in https://github.com/InfuseAI/piperider/pull/407
* [Bug] : forgot decode params (master-list-item) by jonycfu in https://github.com/InfuseAI/piperider/pull/412
* [Bug] Fix custom assertion exception when falsy actual field given by wcchang1115 in https://github.com/InfuseAI/piperider/pull/413
* [Bug] : add props events to propogate state for tab-index reset (Chakra … by jonycfu in https://github.com/InfuseAI/piperider/pull/416
* [Bug] sc-28422 detect csv file encoding and provide suggest ations by kentwelcome in https://github.com/InfuseAI/piperider/pull/415
* [Bug] add default values to assertions check by neighborhood999 in https://github.com/InfuseAI/piperider/pull/419
* [Bug] readme (issue 392) by jonycfu in https://github.com/InfuseAI/piperider/pull/403
* [Bug] Remove snowflake-sqlalchemy dependency by wcchang1115 in https://github.com/InfuseAI/piperider/pull/405
* * [Bug] iterate table.columns instead of assertions to display columns by neighborhood999 in https://github.com/InfuseAI/piperider/pull/391
* [Bug] check base & target is undefined/null and fixed types by neighborhood999 in https://github.com/InfuseAI/piperider/pull/393
* [Bug] sc-28278 Encoded the json payload and decoded them in index.html by kentwelcome in https://github.com/InfuseAI/piperider/pull/395
* [Chore] Compact json of piperider run result by wcchang1115 in https://github.com/InfuseAI/piperider/pull/406
* [Chore] sc-28246 Bump PipeRider version and update sample reports by kentwelcome in https://github.com/InfuseAI/piperider/pull/387

**Full Changelog**: https://github.com/InfuseAI/piperider/compare/v0.7.0...v0.8.0-rc2

0.8.0rc.1

What's Changed
* [Release] sc-28246 Bump PipeRider version and update sample reports by kentwelcome in https://github.com/InfuseAI/piperider/pull/387
* [Feature] Refine the initialization flow for BigQuery by qrtt1 in https://github.com/InfuseAI/piperider/pull/382
* [Feature] single & comparison list overview by neighborhood999 in https://github.com/InfuseAI/piperider/pull/377
* [Feature] sc-27803 Support CSV datasource by duckdb by kentwelcome in https://github.com/InfuseAI/piperider/pull/388
* [Feature] enhance column profiling performance by multithread by wcchang1115 in https://github.com/InfuseAI/piperider/pull/394
* [Feature] Remove descriptions from assertion files by wcchang1115 in https://github.com/InfuseAI/piperider/pull/396
* [Feature] applied table overview with new design by neighborhood999 in https://github.com/InfuseAI/piperider/pull/397
* [Feature] extract metadata of cloud data warehouse by wcchang1115 in https://github.com/InfuseAI/piperider/pull/390
* [Feature] column detail page (sc 27971) by jonycfu in https://github.com/InfuseAI/piperider/pull/399
* [Feature] sc-27803 Add pip intstall piperider[csv] & piperider[parquet] by kentwelcome in https://github.com/InfuseAI/piperider/pull/404
* [Chore] Compact json of piperider run result by wcchang1115 in https://github.com/InfuseAI/piperider/pull/406
* [Bug] iterate table.columns instead of assertions to display columns by neighborhood999 in https://github.com/InfuseAI/piperider/pull/391
* [Bug] check base & target is undefined/null and fixed types by neighborhood999 in https://github.com/InfuseAI/piperider/pull/393
* [Bug] sc-28278 Encoded the json payload and decoded them in index.html by kentwelcome in https://github.com/InfuseAI/piperider/pull/395
* [Bug] readme (issue 392) by jonycfu in https://github.com/InfuseAI/piperider/pull/403
* [Bug] Remove snowflake-sqlalchemy dependency by wcchang1115 in https://github.com/InfuseAI/piperider/pull/405
* [Bug] apply label text max content by neighborhood999 in https://github.com/InfuseAI/piperider/pull/407
* [Bug] : forgot decode params (master-list-item) by jonycfu in https://github.com/InfuseAI/piperider/pull/412
* [Bug] Fix custom assertion exception when falsy actual field given by wcchang1115 in https://github.com/InfuseAI/piperider/pull/413


**Full Changelog**: https://github.com/InfuseAI/piperider/compare/v0.7.0...v0.8.0-rc.1

Page 20 of 26

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.