Spark-expectations

Latest version: v1.1.1

Safety actively analyzes 626474 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

1.1.1

What's Changed
* Update writer.py by jskrajareddy21 in https://github.com/Nike-Inc/spark-expectations/pull/70
* update row dq summary and removing usage of RDD's by jskrajareddy21 & asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/73

New Contributors
* jskrajareddy21 made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/70

**Full Changelog**: https://github.com/Nike-Inc/spark-expectations/compare/v1.1.0...v1.1.1

1.1.0

What's Changed
* rewrote generate_summarised_row_dq_res by IMC07 in https://github.com/Nike-Inc/spark-expectations/pull/66
* Apply spell checks by SamyCoenen in https://github.com/Nike-Inc/spark-expectations/pull/67

New Contributors
* IMC07 made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/66
* SamyCoenen made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/67

**Full Changelog**: https://github.com/Nike-Inc/spark-expectations/compare/v1.0.1...v1.1.0

1.0.1

What's Changed
* Add teams notification feature - Enabling push notifications to teams channel by BharatKumarEY in https://github.com/Nike-Inc/spark-expectations/pull/57
* Update CONTRIBUTORS.md - for PR 57 by BharatKumarEY in https://github.com/Nike-Inc/spark-expectations/pull/59
* Removing Alter statement for stats table after the write by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/61

New Contributors
* BharatKumarEY made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/57

**Full Changelog**: https://github.com/Nike-Inc/spark-expectations/compare/v1.0.0...v1.0.1

1.0.0

What's Changed
* Converting spark udf's to native functions by phanikumarvemuri in https://github.com/Nike-Inc/spark-expectations/pull/26
* Updating Sparksession by sarathchandrabandaru in https://github.com/Nike-Inc/spark-expectations/pull/31
* Add required deps to project by holdenk in https://github.com/Nike-Inc/spark-expectations/pull/33
* Feature remove mandatory args, implemented generic writers to write to any source, resolved many previous bugs by asingamaneni and phanikumarvemuri in https://github.com/Nike-Inc/spark-expectations/pull/40

New Contributors
* sarathchandrabandaru made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/31
* holdenk made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/33

**Full Changelog**: https://github.com/Nike-Inc/spark-expectations/compare/v0.8.1...v1.0.0

0.8.1

What's Changed
* Fix input to final dataframe dq rules by phanikumarvemuri in https://github.com/Nike-Inc/spark-expectations/pull/12
* Feature aplad 9194 by Umeshsp22 in https://github.com/Nike-Inc/spark-expectations/pull/18
* Made logos transparent by jhollow in https://github.com/Nike-Inc/spark-expectations/pull/19
* fixing the bug for the cerberus import and remove nsp configuration by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/21
* fix the bug for Final table write happens before running final_agg_dq and final_query_dq expectations by phanikumarvemuri in https://github.com/Nike-Inc/spark-expectations/pull/22
* Update CONTRIBUTORS.md by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/24

New Contributors
* phanikumarvemuri made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/12
* Umeshsp22 made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/18
* jhollow made their first contribution in https://github.com/Nike-Inc/spark-expectations/pull/19

**Full Changelog**: https://github.com/Nike-Inc/spark-expectations/compare/v0.8.0...v0.8.1

0.8.0

What's Changed
* Source code moved from Nike inner repository to Open Source by asingamaneni
* Adding github actions by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/2
* adding more github badges by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/3
* Updating the scope value by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/4
* Update issue templates by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/8
* Feature infra changes by asingamaneni in https://github.com/Nike-Inc/spark-expectations/pull/10


**Full Changelog**: https://github.com/Nike-Inc/spark-expectations/commits/v0.8.0

Links

Releases

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.