Tensorflow-data-validation

Major Features and Improvements

* N/A

Bug Fixes and Other Changes

* Relax dependency on Protobuf to include version 5.x

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A

Major Features and Improvements

* N/A

Bug Fixes and Other Changes

* Depends on `tensorflow>=2.16,<2.17`.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A

Major Features and Improvements

* N/A

Bug Fixes and Other Changes

* Fix bug in implementation of custom validations.
* Depends on `tensorflow>=2.15,<2.16`.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* N/A

Major Features and Improvements

* N/A

Bug Fixes and Other Changes

* When computing cross feature statistics, skip configured crosses that
include features of unsupported types (i.e., are not univalent numeric
features).
* Update the minimum Bazel version required to build TFDV to 6.1.0.
* Modifies get_statistics_html() utility function to return a value indicating
a dataset has no examples.
* Outputs both a standard and a quantiles histogram for level N value list
length statistics.
* Add a `macos_arm64` config setting to the TFDV build file. NOTE: At this
time, any M1 support for TFDV is experimental and untested.
* Bumps the pybind11 version to 2.11.1.
* Depends on `tensorflow~=2.15.0`.
* Depends on `apache-beam[gcp]>=2.53.0,<3` for Python 3.11 and on
`apache-beam[gcp]>=2.47.0,<3` for 3.9 and 3.10.
* Depends on `protobuf>=4.25.2,<5` for Python 3.11 and on `protobuf>3.20.3,<5`
for 3.9 and 3.10.
* For nested features with N nested levels (N > 1), the statistics counting
the number of values in `CommonStatistics` and `WeightedCommonStatistics`
will rely on the innermost level.

Known Issues

* N/A

Breaking Changes

* N/A

Deprecations

* Deprecated python 3.8 support.
* Deprecated Windows support.

Major Features and Improvements

* N/A

Bug Fixes and Other Changes

* Bumped the Ubuntu version on which TFX-BSL is tested to 20.04 (previously
was 16.04).
* Use platforms instead of bazel_tools//platforms to specify constraints in
OSS build.
* Depends on `pyarrow>=10,<11`.
* Depends on `apache-beam>=2.47,<3`.
* Depends on `numpy>=1.22.0`.
* Depends on `tensorflow>=2.13.0,<3`.

Known Issues

* N/A

Breaking Changes

* Moves some non-public arrow_util functions to TFX-BSL.
* Changes SkewPair proto to store tf.Examples in serialized format.

Deprecations

* N/A

Major Features and Improvements

* Introduces a Schema option `HistogramSelection` to allow numeric drift/skew
calculations to use QUANTILES histograms, which are more robust to outliers.

Bug Fixes and Other Changes

* Rename `statistics_io_impl` and `default_record_sink` (not part of public API).
* Update the minimum Bazel version required to build TFDV to 5.3.0.
* Depends on `numpy~=1.22.0`.
* Depends on `pyfarmhash>=0.2.2,<0.4`.
* Depends on `tensorflow>=2.12.0,<2.13`.
* Depends on `protobuf>=3.20.3,<5`.
* Depends on `tfx-bsl>=1.13.0,<1.14.0`.
* Depends on `tensorflow-metadata>=1.13.1,<1.14.0`.

Known Issues

* N/A

Breaking Changes

* Jensen-Shannon divergence now treats NaN values as always contributing to
higher drift score.

Deprecations

* Deprecated python 3.7 support.