Optax

New Contributors
* gbruno16 made their first contribution in https://github.com/google-deepmind/optax/pull/894
* satyenkale made their first contribution in https://github.com/google-deepmind/optax/pull/901
* GrantMcConachie made their first contribution in https://github.com/google-deepmind/optax/pull/897
* fabian-sp made their first contribution in https://github.com/google-deepmind/optax/pull/721
* lukekulik made their first contribution in https://github.com/google-deepmind/optax/pull/974
* jakevdp made their first contribution in https://github.com/google-deepmind/optax/pull/987

**Full Changelog**: https://github.com/google-deepmind/optax/compare/v0.2.2...v0.2.3

What's Changed
* Added mathematical description to Noisy SGD by hmludwig in https://github.com/google-deepmind/optax/pull/857
* Use sphinx-contributors for an automated contributors list. by fabianp in https://github.com/google-deepmind/optax/pull/841
* Implementation of the Polyak SGD solver by copybara-service in https://github.com/google-deepmind/optax/pull/718
* Document the extra args of the update function in docstring by copybara-service in https://github.com/google-deepmind/optax/pull/864
* Utility to set value in a pytree (and so in state) by copybara-service in https://github.com/google-deepmind/optax/pull/865
* Added mathematical description to AdaBelief docstring by hmludwig in https://github.com/google-deepmind/optax/pull/869
* FIX RST formatting in inject hyperparams by fabianp in https://github.com/google-deepmind/optax/pull/867
* Warn that in future arguments after the initial (prediction, ground_truth) positional arguments will become keyword-only in optax losses. by copybara-service in https://github.com/google-deepmind/optax/pull/863
* Upstream missing jaxopt losses to optax - Part 2/N by copybara-service in https://github.com/google-deepmind/optax/pull/872
* Fix error `reduce_on_plateau.ipynb:20002: WARNING: No source code lexer found for notebook cell` by copybara-service in https://github.com/google-deepmind/optax/pull/875
* docstring cosmetic improvements by fabianp in https://github.com/google-deepmind/optax/pull/879
* Extend capabilities of tree_get, tree_set. by copybara-service in https://github.com/google-deepmind/optax/pull/878
* [DOC] Add to the gallery an example on a small language model by copybara-service in https://github.com/google-deepmind/optax/pull/866
* Update reduce_on_plateau to handle training average loss. by copybara-service in https://github.com/google-deepmind/optax/pull/883
* Fix notebook reduce_on_plateau by copybara-service in https://github.com/google-deepmind/optax/pull/887
* ENH: extend power_iteration to accept a matrix in implicit form by copybara-service in https://github.com/google-deepmind/optax/pull/858
* Document changes in power_iteration by copybara-service in https://github.com/google-deepmind/optax/pull/889
* Release of version 0.2.2 by copybara-service in https://github.com/google-deepmind/optax/pull/892


**Full Changelog**: https://github.com/google-deepmind/optax/compare/v0.2.1...v0.2.2

**Full Changelog**: https://github.com/google-deepmind/optax/compare/v0.2.0...v0.2.1

New Contributors
* JayJayleee made their first contribution in https://github.com/google-deepmind/optax/pull/762
* yixiaoer made their first contribution in https://github.com/google-deepmind/optax/pull/785
* mblondel made their first contribution in https://github.com/google-deepmind/optax/pull/790
* WangHanSolo made their first contribution in https://github.com/google-deepmind/optax/pull/782
* hmludwig made their first contribution in https://github.com/google-deepmind/optax/pull/804

**Full Changelog**: https://github.com/google-deepmind/optax/compare/v0.1.9...v0.2.0

What's Changed
* update URL github.com/deepmind -> github.com/google-deepmind and branch to main by copybara-service in https://github.com/google-deepmind/optax/pull/710
* Show CI results only for the main branch by fabianp in https://github.com/google-deepmind/optax/pull/716
* typo nesterov -> Nesterov by fabianp in https://github.com/google-deepmind/optax/pull/722
* Add `atol` option to `contrib.reduce_on_plateau()` by stefanocortinovis in https://github.com/google-deepmind/optax/pull/698
* add docs for tree_utils module by amosyou in https://github.com/google-deepmind/optax/pull/724
* Simplifications on the doc by copybara-service in https://github.com/google-deepmind/optax/pull/727
* add nadam and nadamw optimizers by copybara-service in https://github.com/google-deepmind/optax/pull/723
* Add `versionadded` and `seealso` metadata to (n)adam(w) solvers by copybara-service in https://github.com/google-deepmind/optax/pull/729
* Enable doctests in sphinx and fix failing doctests by fabianp in https://github.com/google-deepmind/optax/pull/733
* Add missing members to the doc by copybara-service in https://github.com/google-deepmind/optax/pull/734
* FIX sphinx warnings "this document is not included in any toctree" by fabianp in https://github.com/google-deepmind/optax/pull/736
* feat(ci): drop `setup.py` from publishing CI by SauravMaheshkar in https://github.com/google-deepmind/optax/pull/737
* Minor tweak in pypi-publish.yml by fabianp in https://github.com/google-deepmind/optax/pull/739
* [TEST] Install virtual environment in current directory instead of /tmp by fabianp in https://github.com/google-deepmind/optax/pull/746
* migrate to pyproject by copybara-service in https://github.com/google-deepmind/optax/pull/747
* Deprecate optax.inject_stateful_hyperparameters and replace it with optax.inject_hyperparameters by copybara-service in https://github.com/google-deepmind/optax/pull/730
* Clarify inclusion criteria into optax and optax.contrib by copybara-service in https://github.com/google-deepmind/optax/pull/742
* fix the default learning rate in prodigy by konstmish in https://github.com/google-deepmind/optax/pull/740
* update and merge quickstart notebooks by amosyou in https://github.com/google-deepmind/optax/pull/726
* Remove redundant examples from README by mmhamdy in https://github.com/google-deepmind/optax/pull/754
* Instructions to build the doc and option to build the docs without executing the notebooks. by copybara-service in https://github.com/google-deepmind/optax/pull/759
* Remove license statement from notebooks by renuka010 in https://github.com/google-deepmind/optax/pull/764

New Contributors
* amosyou made their first contribution in https://github.com/google-deepmind/optax/pull/724
* konstmish made their first contribution in https://github.com/google-deepmind/optax/pull/740
* renuka010 made their first contribution in https://github.com/google-deepmind/optax/pull/764

**Full Changelog**: https://github.com/google-deepmind/optax/compare/v0.1.8...v0.1.9

What's Changed
* Remove legacy symbols. by copybara-service in https://github.com/google-deepmind/optax/pull/397
* Move second order utilities to dedicated sub-package. by copybara-service in https://github.com/google-deepmind/optax/pull/588
* Move stochastic gradient estimation functions to separate monte_carlo subpackage. by copybara-service in https://github.com/google-deepmind/optax/pull/589
* Move losses to dedicated sub-package. by copybara-service in https://github.com/google-deepmind/optax/pull/590
* Note TF's adam implementation difference by vwxyzjn in https://github.com/google-deepmind/optax/pull/572
* Note RMSProp PyTorch vs Optax implementation difference by vwxyzjn in https://github.com/google-deepmind/optax/pull/595
* Move complex_valued from experimental/ to contrib/. by copybara-service in https://github.com/google-deepmind/optax/pull/602
* Make radam docstring point to radam paper. by carlosgmartin in https://github.com/google-deepmind/optax/pull/510
* COntinuous COin Betting algorithm by albcab in https://github.com/google-deepmind/optax/pull/536
* Update second_order package internal structure. by copybara-service in https://github.com/google-deepmind/optax/pull/625
* Update github URL + nicer console highlighting by copybara-service in https://github.com/google-deepmind/optax/pull/628
* Add import stub. by copybara-service in https://github.com/google-deepmind/optax/pull/633
* Start optax.projections subpackage and add projection_non_negative. by copybara-service in https://github.com/google-deepmind/optax/pull/632
* Also apply masking to compatible extra_args. by copybara-service in https://github.com/google-deepmind/optax/pull/620
* Add tree_vdot to tree_utils. by copybara-service in https://github.com/google-deepmind/optax/pull/634
* Add: merge multistep and apply_every logic by celiolarcher in https://github.com/google-deepmind/optax/pull/596
* Remove redundant requirements folder by copybara-service in https://github.com/google-deepmind/optax/pull/643
* Run pytype on Python 3.11 by fabianp in https://github.com/google-deepmind/optax/pull/657
* Move MLP MNIST example to Colab notebook by copybara-service in https://github.com/google-deepmind/optax/pull/658
* Move DP-SGD example to Colab by copybara-service in https://github.com/google-deepmind/optax/pull/660
* Add tensorflow as dependency for the examples by copybara-service in https://github.com/google-deepmind/optax/pull/661
* Add tensorflow-datasets to doc requirements by copybara-service in https://github.com/google-deepmind/optax/pull/662
* D-Adaptation and Prodigy contrib implementations by adefazio in https://github.com/google-deepmind/optax/pull/651
* Fix typing issue in prodigy.py for python 3.9 by copybara-service in https://github.com/google-deepmind/optax/pull/671
* Fix CIFAR10 Flax&Optax example name in the gallery by copybara-service in https://github.com/google-deepmind/optax/pull/672
* Move flax example to Colab by copybara-service in https://github.com/google-deepmind/optax/pull/670
* update citation url since http://github.com/deepmind is now empty by copybara-service in https://github.com/google-deepmind/optax/pull/667
* Move Haiku example to Colab notebook by copybara-service in https://github.com/google-deepmind/optax/pull/673
* run pytype also on the contrib directory by copybara-service in https://github.com/google-deepmind/optax/pull/675
* Add reduce_on_plateau LR scheduler to contrib directory. by vz415 in https://github.com/google-deepmind/optax/pull/629
* Add to .gitignore temporary directories of building the docs. by fabianp in https://github.com/google-deepmind/optax/pull/680
* Add the SAM example to the example gallery by fabianp in https://github.com/google-deepmind/optax/pull/681
* Add reduce_on_plateau example (https://github.com/google-deepmind/optax/issues/679) by copybara-service in https://github.com/google-deepmind/optax/pull/683
* Wrong image path on redue on plateau example by copybara-service in https://github.com/google-deepmind/optax/pull/686
* Remove execution timeout (https://github.com/google-deepmind/optax/issues/687) by copybara-service in https://github.com/google-deepmind/optax/pull/689
* Documentation Typo Fixes for apply_if_finite by mharradon in https://github.com/google-deepmind/optax/pull/696
* FIX typos in public readme by copybara-service in https://github.com/google-deepmind/optax/pull/691
* Add adversarial training example by mmhamdy in https://github.com/google-deepmind/optax/pull/682
* Divide API documentation by MaanasArora in https://github.com/google-deepmind/optax/pull/688
* Avoid scalar conversion of non-scalar arrays by copybara-service in https://github.com/google-deepmind/optax/pull/693
* Improving docstrings for schedules. by copybara-service in https://github.com/google-deepmind/optax/pull/692
* Fix `TypeError` in `contrib.reduce_on_plateau()` when x64 is enabled by stefanocortinovis in https://github.com/google-deepmind/optax/pull/697
* Fix some doc links in README.md and other files 665 by Bigpet in https://github.com/google-deepmind/optax/pull/706
* replace branch master by main by copybara-service in https://github.com/google-deepmind/optax/pull/709
* New optax release by copybara-service in https://github.com/google-deepmind/optax/pull/701

New Contributors
* vwxyzjn made their first contribution in https://github.com/google-deepmind/optax/pull/572
* carlosgmartin made their first contribution in https://github.com/google-deepmind/optax/pull/510
* albcab made their first contribution in https://github.com/google-deepmind/optax/pull/536
* celiolarcher made their first contribution in https://github.com/google-deepmind/optax/pull/596
* adefazio made their first contribution in https://github.com/google-deepmind/optax/pull/651
* vz415 made their first contribution in https://github.com/google-deepmind/optax/pull/629
* mharradon made their first contribution in https://github.com/google-deepmind/optax/pull/696
* mmhamdy made their first contribution in https://github.com/google-deepmind/optax/pull/682
* MaanasArora made their first contribution in https://github.com/google-deepmind/optax/pull/688
* stefanocortinovis made their first contribution in https://github.com/google-deepmind/optax/pull/697
* Bigpet made their first contribution in https://github.com/google-deepmind/optax/pull/706

**Full Changelog**: https://github.com/google-deepmind/optax/compare/v0.1.7...v0.1.8