Tensorflow-federated

Major Features and Improvements

* Added `tff.learning.models.FunctionModel` support to all methods in
`tff.learning.algorithms`.
* Added support for `tf.data.DataSpec` to `tff.types.infer_unplaced_type`.
* Use a `tensorflow::ThreadPool` for parallelism inside the C++
`TensorFlowExecutor`.
* Introduced a new `tff.experimental_tf_fn_computation` tracing decorator that
uses `FunctionDef` instead of `GraphDef` tracing, providing `tf.function`
auto-control-dependencies.
* Renamed `number_of_clients` to `num_clients` in the federated program API.
* Replaced the following API with composers API in `tff.learning.templates`.
* `tff.learning.framework.build_model_delta_optimizer_process`
* `tff.learning.framework.ClientDeltaFn`

Bug Fixes

* Fixed a bug in the “Client-efficient large-model federated learning”
tutorial to use the correct dense shape.

Major Features and Improvements

* Added `tff.learning.models.FunctionalModel` support to
`tff.learning.algorithms.build_mime_lite`.
* Updated `tensorflow-privacy` to version `0.8.6`.
* Added an abstract interface describing an asynchronous context
* Removed references to `tff.framework.Context`.
* Added `tff.simulation.datasets.gldv2.get_synthetic`.
* Added prefetching data source in `tff.program.PrefetchingDataSource`.

Breaking Changes

* Deleted deprecated
`tff.learning.framework.build_encoded_broadcast_process_from_model`.
* Deprecated `tff.learning.ModelWeights` and alias
`tff.learning.framework.ModelWeights`, has now moved to
`tff.learning.models.ModelWeights`. Code should be updated before the next
release.

Bug Fixes

* Fixed a bug with variable creation order of metrics in
`tff.learning.models.functional_model_from_keras`.
* Improved `tff.tf_computation` tracing to also trace `functools.partial`
objects.

Known Bugs

* Colab compatibility: TFF requires Python 3.9 while Colab runtime uses Python
3.7.

Major Features and Improvements

* Added support for Python 3.10.
* Improved support for `numpy` values in the `tff.program` API.
* Increased dataset serialization size limit to 100MB.
* Added a new method `tff.learning.ModelWeights.convert_variables_to_arrays`.
* Added new metrics aggregation factories under `tff.learning.metrics`.
* Parallelized aggregation in `tff.framework.ComposingExecutorFactory`.

Breaking Changes

* Updated to use `jax` and `jaxlib` version `0.3.14`.
* Renamed `tff.program.CoroValueReference` to
`tff.program.AwaitableValueReference` to reflect the relaxed contract.

Bug Fixes

* Improved documentation for `tff.simulation.build_uniform_sampling_fn`,
`tff.learning.robust_aggregator`,
`tff.aggregators.PrivateQuantileEstimationProcess`.
* Fixed documentation bug for tutorial “High-performance Simulation with
Kubernetes”.
* Fixed bug where momentum hyperparameters were added to SGDM optimizer when
momentum was set to 0.
* Removed assertion that preprocessed datasets in a
`tff.simulation.baselines.BaselineTask` have the same element structure.
* Fixed a memory leak when moving numpy arrays across the Python and C++
boundary in the C++ executor.
* Fixed bug in the federated program API when using multiple release managers
to release the same value.

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:
Madhava Jay, nbishdev

Major Features and Improvements

* Added support for `tff.learning.models.FunctionalModel` to
`tff.learning.algorithms.build_fed_sgd` and
`tff.learning.algorithms.build_fed_prox`.
* Increased the gRPC message limit from 1 GB to 2 GB.
* Added hyperparameter getters/setters to various components in tff.learning.

Breaking Changes

* Updated `tensorflow` to version `2.10`.

Bug Fixes

* Improved documentation for
`tff.analytics.heavy_hitters.iblt.build_iblt_computation()`.
* Fixed incorrect docstring of `tff.federated_select`.
* Fixed typo in federated program example.

Major Features and Improvements

* Added get/set_hparams methods to `tff.learning.templates.ClientWorkProcess`.
* Added `tff.learning.algorithms.build_mime_lite_with_optimizer_schedule`.
* Updated `tensorflow-privacy` to version `0.8.5`.
* Added `tff.learning.entropy_compression_aggregator`.
* Added `tff.aggregators.EliasGammaEncodedSumFactory`.
* Added `tff.program.ClientIdDataSource` and
`tff.program.ClientIdDataSourceIterator`, for working with a data source of
ids of federated clients.

Breaking Changes

* Removed prototype IREE backend.
* Added new dependency on TensorFlow Compression.

Bug Fixes

* Fixed implementation of the `loading_remote_data` tutorial.
* Corrected the docstring of
`tff.simulation.datasets.stackoverflow.get_synthetic`.

Known Bugs

* TFF's Python 3.9 typing conflicts with Colab's Python 3.7 runtime.

Major Features and Improvements

* Updated to use `Bazel` version `5.3.0`.
* Updated the conventions used to specify the version of a Python dependency,
see https://github.com/tensorflow/federated/blob/main/requirements.txt for
more information.
* Updated the `setup.py` to explicitly fail to `pip install` in Python 3.10.
This has always been failing at runtime, but now explicitly fails to install
using `pip`.
* Refreshed loading_remote_data notebook content and added content for
`FederatedDataSource`.
* Added a TFF `type_signature` attribute to objects of type `MapReduceForm`.
* Added a
[series](https://github.com/tensorflow/federated/blob/main/docs/design/TFF_101_lingua_federata.pdf)
[of](https://github.com/tensorflow/federated/blob/main/docs/design/TFF_102_executors.pdf)
[slides](https://github.com/tensorflow/federated/blob/main/docs/design/TFF_103_transformations.pdf)
to the GitHub repo (so not part of the PIP package) which detail a technical
deep dive into TFF.

Breaking Changes

* Bumped tf-privacy version to `0.8.4`.
* Bumped tf-model-optimization version to `0.8.3`.
* Removed `initialize` from `MapReduceForm`.
* `SequenceType` now automatically casts any `StructWithPythonType` that
contains a `list` to a `tuple` for `tf.data` compatibility.
* Unified the `model_fn` and `model` parameters of
`tff.learning.algorithms.build_weighted_fed_avg`.
* `MapReduceForm` now takes a `type_signature` argument in its constructor,
and no longer takes an `initialize` argument.
* `MapReduceForm` no longer contains an `initialize` attribute.

Bug Fixes

* Relaxed overly strict type equivalence check to assignability in TFF-TF code
generation.