Keras

Please see the release history at https://github.com/tensorflow/tensorflow/releases/tag/v2.10.0-rc3 for more details.

What's Changed
* Fix TypeError positional argument when LossScalerOptimizer is used conjointly with tfa wrappers by lucasdavid in https://github.com/keras-team/keras/pull/16332
* Add type check to axis by sachinprasadhs in https://github.com/keras-team/keras/pull/16208
* minor documention fix by bmatschke in https://github.com/keras-team/keras/pull/16331
* Fix typos in data_adapter.py by taegeonum in https://github.com/keras-team/keras/pull/16326
* Add `exclude_from_weight_decay` to AdamW by markub3327 in https://github.com/keras-team/keras/pull/16274
* Switching learning/brain dependency to OSS compatible test_util by copybara-service in https://github.com/keras-team/keras/pull/16362
* Typo fix in LSTM docstring by peskaf in https://github.com/keras-team/keras/pull/16364
* Copy loss and metric to prevent side effect by drauh in https://github.com/keras-team/keras/pull/16360
* Denormalization layer by markub3327 in https://github.com/keras-team/keras/pull/16350
* Fix `reset_states` not working when invoked within a `tf.function` in graph mode. by copybara-service in https://github.com/keras-team/keras/pull/16400
* Reduce the complexity of the base layer by pulling out the logic related to handling call function args to a separate class. by copybara-service in https://github.com/keras-team/keras/pull/16375
* Add subset="both" functionality to {image|text}_dataset_from_directory() by Haaris-Rahman in https://github.com/keras-team/keras/pull/16413
* Fix non-float32 efficientnet calls by hctomkins in https://github.com/keras-team/keras/pull/16402
* Fix prediction with structured output by itmo153277 in https://github.com/keras-team/keras/pull/16408
* Add reference to resource variables. by sachinprasadhs in https://github.com/keras-team/keras/pull/16409
* added audio_dataset.py by hazemessamm in https://github.com/keras-team/keras/pull/16388
* Fix Syntax error for combined_model.compile of WideDeepModel by gadagashwini in https://github.com/keras-team/keras/pull/16447
* Missing `f` prefix on f-strings fix by code-review-doctor in https://github.com/keras-team/keras/pull/16459
* Update CONTRIBUTING.md by rthadur in https://github.com/keras-team/keras/pull/15998
* adds split_dataset utility by prakashsellathurai in https://github.com/keras-team/keras/pull/16398
* Support increasing batch size by markus-hinsche in https://github.com/keras-team/keras/pull/16337
* Add ConvNeXt models by sayakpaul in https://github.com/keras-team/keras/pull/16421
* Fix OrthogonalRegularizer to implement the (1,1) matrix norm by Kiwiakos in https://github.com/keras-team/keras/pull/16521
* fix: weight keys so that imagenet init works by sayakpaul in https://github.com/keras-team/keras/pull/16528
* Preprocess input correction by AdityaKane2001 in https://github.com/keras-team/keras/pull/16527
* Fix typo in documentation by sushreebarsa in https://github.com/keras-team/keras/pull/16534
* Update index_lookup.py by tilakrayal in https://github.com/keras-team/keras/pull/16460
* update codespaces bazel install by haifeng-jin in https://github.com/keras-team/keras/pull/16575
* reduce too long lines in engine/ by haifeng-jin in https://github.com/keras-team/keras/pull/16579
* Fix typos by eltociear in https://github.com/keras-team/keras/pull/16568
* Fix mixed precision serialization of group convs by lgeiger in https://github.com/keras-team/keras/pull/16571
* reduce layers line-too-long by haifeng-jin in https://github.com/keras-team/keras/pull/16580
* resolve line-too-long in root directory by haifeng-jin in https://github.com/keras-team/keras/pull/16584
* resolve line-too-long in metrics by haifeng-jin in https://github.com/keras-team/keras/pull/16586
* resolve line-too-long in optimizers by haifeng-jin in https://github.com/keras-team/keras/pull/16587
* resolve line-too-long in distribute by haifeng-jin in https://github.com/keras-team/keras/pull/16594
* resolve line-too-long in integration_test by haifeng-jin in https://github.com/keras-team/keras/pull/16599
* resovle line-too-long in legacy-tf-layers by haifeng-jin in https://github.com/keras-team/keras/pull/16600
* resolve line-too-long in initializers by haifeng-jin in https://github.com/keras-team/keras/pull/16598
* resolve line-too-long in api by haifeng-jin in https://github.com/keras-team/keras/pull/16592
* resolve line-too-long in benchmarks by haifeng-jin in https://github.com/keras-team/keras/pull/16593
* resolve line-too-long in feature_column by haifeng-jin in https://github.com/keras-team/keras/pull/16597
* resolve line-too-long in datasets by haifeng-jin in https://github.com/keras-team/keras/pull/16591
* resolve line-too-long in dtensor by haifeng-jin in https://github.com/keras-team/keras/pull/16595
* resolve line-too-long in estimator by haifeng-jin in https://github.com/keras-team/keras/pull/16596
* resolve line-too-long in applications by haifeng-jin in https://github.com/keras-team/keras/pull/16590
* resolve line-too-long in mixed_precision by haifeng-jin in https://github.com/keras-team/keras/pull/16605
* resolve line-too-long in models by haifeng-jin in https://github.com/keras-team/keras/pull/16606
* resolve line-too-long in premade_models by haifeng-jin in https://github.com/keras-team/keras/pull/16608
* resolve line-too-long in tests by haifeng-jin in https://github.com/keras-team/keras/pull/16613
* resolve line-too-long in testing_infra by haifeng-jin in https://github.com/keras-team/keras/pull/16612
* resolve line-too-long in saving by haifeng-jin in https://github.com/keras-team/keras/pull/16611
* resolve line-too-long in preprocessing by haifeng-jin in https://github.com/keras-team/keras/pull/16609
* resolve line-too-long in utils by haifeng-jin in https://github.com/keras-team/keras/pull/16614
* Optimize L2 Regularizer (use tf.nn.l2_loss) by szutenberg in https://github.com/keras-team/keras/pull/16537
* let the linter ignore certain lines, prepare to enforce line length by haifeng-jin in https://github.com/keras-team/keras/pull/16617
* Fix typo by m-ahmadi in https://github.com/keras-team/keras/pull/16607
* Explicitely set `AutoShardPolicy.DATA` for `TensorLike` datasets by lgeiger in https://github.com/keras-team/keras/pull/16604
* Fix all flake8 errors by haifeng-jin in https://github.com/keras-team/keras/pull/16621
* Update lint.yml by haifeng-jin in https://github.com/keras-team/keras/pull/16648
* Fix typo error of tf.compat.v1.keras.experimental for export and load model by gadagashwini in https://github.com/keras-team/keras/pull/16636
* Fix documentation in keras.datasets.imdb by luckynozomi in https://github.com/keras-team/keras/pull/16673
* Update __init__.py by Wehzie in https://github.com/keras-team/keras/pull/16557
* Fix documentation in keras.layers.attention.multi_head_attention by balvisio in https://github.com/keras-team/keras/pull/16683
* Fix missed parameter from AUC config by weipeilun in https://github.com/keras-team/keras/pull/16499
* Fix bug for KerasTensor._keras_mask should be None by haifeng-jin in https://github.com/keras-team/keras/pull/16689
* Fixed some spellings by synandi in https://github.com/keras-team/keras/pull/16693
* Fix batchnorm momentum in ResNetRS by shkarupa-alex in https://github.com/keras-team/keras/pull/16726
* Add variable definitions in optimizer usage example by miker2241 in https://github.com/keras-team/keras/pull/16731
* Fixed issue 16749 by asukakenji in https://github.com/keras-team/keras/pull/16751
* Fix usage of deprecated Pillow interpolation methods by neoaggelos in https://github.com/keras-team/keras/pull/16746
* :memo: Add typing to some callback classes by gabrieldemarmiesse in https://github.com/keras-team/keras/pull/16692
* Add support for Keras mask & causal mask to MultiHeadAttention by ageron in https://github.com/keras-team/keras/pull/16619
* Update standard name by chunduriv in https://github.com/keras-team/keras/pull/16772
* Fix error when labels contains brackets when plotting model by cBournhonesque in https://github.com/keras-team/keras/pull/16739
* Fixing the incorrect link in input_layer.py by tilakrayal in https://github.com/keras-team/keras/pull/16767
* Formatted callback.py to render correctly by jvishnuvardhan in https://github.com/keras-team/keras/pull/16765
* Fixed typo in docs by ltiao in https://github.com/keras-team/keras/pull/16778
* docs: Fix a few typos by timgates42 in https://github.com/keras-team/keras/pull/16789
* Add ignore_class to sparse crossentropy and IoU by lucasdavid in https://github.com/keras-team/keras/pull/16712
* Updated f-string method by cyai in https://github.com/keras-team/keras/pull/16799
* Fix NASNet input shape computation by ianstenbit in https://github.com/keras-team/keras/pull/16818
* Fix incorrect ref. to learning_rate_schedule during module import by lucasdavid in https://github.com/keras-team/keras/pull/16813
* Fixing the incorrect link in backend.py by tilakrayal in https://github.com/keras-team/keras/pull/16806
* Corrected DepthwiseConv1D docstring by AdityaKane2001 in https://github.com/keras-team/keras/pull/16807
* Typo and grammar: "recieved" by ehrencrona in https://github.com/keras-team/keras/pull/16814
* Fix typo in doc by DyeKuu in https://github.com/keras-team/keras/pull/16821
* Update README.md by freddy1020 in https://github.com/keras-team/keras/pull/16823
* Updated f-string method by cyai in https://github.com/keras-team/keras/pull/16775
* Add `is_legacy_optimizer` to optimizer config to keep saving/loading consistent. by copybara-service in https://github.com/keras-team/keras/pull/16842
* Add `is_legacy_optimizer` to optimizer config to keep saving/loading … by qlzh727 in https://github.com/keras-team/keras/pull/16856

New Contributors
* bmatschke made their first contribution in https://github.com/keras-team/keras/pull/16331
* taegeonum made their first contribution in https://github.com/keras-team/keras/pull/16326
* markub3327 made their first contribution in https://github.com/keras-team/keras/pull/16274
* peskaf made their first contribution in https://github.com/keras-team/keras/pull/16364
* Haaris-Rahman made their first contribution in https://github.com/keras-team/keras/pull/16413
* hctomkins made their first contribution in https://github.com/keras-team/keras/pull/16402
* itmo153277 made their first contribution in https://github.com/keras-team/keras/pull/16408
* hazemessamm made their first contribution in https://github.com/keras-team/keras/pull/16388
* prakashsellathurai made their first contribution in https://github.com/keras-team/keras/pull/16398
* markus-hinsche made their first contribution in https://github.com/keras-team/keras/pull/16337
* sayakpaul made their first contribution in https://github.com/keras-team/keras/pull/16421
* Kiwiakos made their first contribution in https://github.com/keras-team/keras/pull/16521
* sushreebarsa made their first contribution in https://github.com/keras-team/keras/pull/16534
* tilakrayal made their first contribution in https://github.com/keras-team/keras/pull/16460
* eltociear made their first contribution in https://github.com/keras-team/keras/pull/16568
* szutenberg made their first contribution in https://github.com/keras-team/keras/pull/16537
* m-ahmadi made their first contribution in https://github.com/keras-team/keras/pull/16607
* luckynozomi made their first contribution in https://github.com/keras-team/keras/pull/16673
* Wehzie made their first contribution in https://github.com/keras-team/keras/pull/16557
* balvisio made their first contribution in https://github.com/keras-team/keras/pull/16683
* weipeilun made their first contribution in https://github.com/keras-team/keras/pull/16499
* synandi made their first contribution in https://github.com/keras-team/keras/pull/16693
* shkarupa-alex made their first contribution in https://github.com/keras-team/keras/pull/16726
* miker2241 made their first contribution in https://github.com/keras-team/keras/pull/16731
* asukakenji made their first contribution in https://github.com/keras-team/keras/pull/16751
* neoaggelos made their first contribution in https://github.com/keras-team/keras/pull/16746
* cBournhonesque made their first contribution in https://github.com/keras-team/keras/pull/16739
* ltiao made their first contribution in https://github.com/keras-team/keras/pull/16778
* timgates42 made their first contribution in https://github.com/keras-team/keras/pull/16789
* ianstenbit made their first contribution in https://github.com/keras-team/keras/pull/16818
* ehrencrona made their first contribution in https://github.com/keras-team/keras/pull/16814
* DyeKuu made their first contribution in https://github.com/keras-team/keras/pull/16821
* freddy1020 made their first contribution in https://github.com/keras-team/keras/pull/16823

**Full Changelog**: https://github.com/keras-team/keras/compare/v2.9.0-rc0...v2.10.0-rc1

Please see the release history at https://github.com/tensorflow/tensorflow/releases/tag/v2.9.0 for more details.

**Full Changelog**: https://github.com/keras-team/keras/compare/v2.8.0...v2.9.0

What's Changed
* Cherrypick DTensor docstring fix for 2.9 release. by qlzh727 in https://github.com/keras-team/keras/pull/16434
* Cherrypick for RandomContrast update by qlzh727 in https://github.com/keras-team/keras/pull/16435
* Cherrypick ImageAugmetation related change to R2.9 by qlzh727 in https://github.com/keras-team/keras/pull/16454


**Full Changelog**: https://github.com/keras-team/keras/compare/v2.9.0-rc1...v2.9.0-rc2

What's Changed
* Cherrypick Keras DTensor related updates into keras 2.9 by qlzh727 in https://github.com/keras-team/keras/pull/16379


**Full Changelog**: https://github.com/keras-team/keras/compare/v2.9.0-rc0...v2.9.0-rc1

Please see https://github.com/tensorflow/tensorflow/blob/r2.9/RELEASE.md for Keras release notes.

Major Features and Improvements

* `tf.keras`:
* Added `tf.keras.applications.resnet_rs` models. This includes the `ResNetRS50`, `ResNetRS101`, `ResNetRS152`, `ResNetRS200`, `ResNetRS270`, `ResNetRS350` and `ResNetRS420` model architectures. The ResNetRS models are based on the architecture described in [Revisiting ResNets: Improved Training and Scaling Strategies](https://arxiv.org/pdf/2103.07579.pdf)
* Added `tf.keras.optimizers.experimental.Optimizer`. The reworked optimizer gives more control over different phases of optimizer calls, and is easier to customize. We provide Adam, SGD, Adadelta, AdaGrad and RMSprop optimizers based on `tf.keras.optimizers.experimental.Optimizer`. Generally the new optimizers work in the same way as the old ones, but support new constructor arguments. In the future, the symbols `tf.keras.optimizers.Optimizer`/`Adam`/etc will point to the new optimizers, and the previous generation of optimizers will be moved to `tf.keras.optimizers.legacy.Optimizer`/`Adam`/etc.
* Added L2 unit normalization layer `tf.keras.layers.UnitNormalization`.
* Added `tf.keras.regularizers.OrthogonalRegularizer`, a new regularizer that encourages orthogonality between the rows (or columns) or a weight matrix.
* Added `tf.keras.layers.RandomBrightness` layer for image preprocessing.
* Added APIs for switching between interactive logging and absl logging. By default, Keras always writes the logs to stdout. However, this is not optimal in a non-interactive environment, where you don't have access to stdout, but can only view the logs. You can use `tf.keras.utils.disable_interactive_logging()` to write the logs to ABSL logging. You can also use `tf.keras.utils.enable_interactive_logging()` to change it back to stdout, or `tf.keras.utils.is_interactive_logging_enabled()` to check if interactive logging is enabled.
* Changed default value for the `verbose` argument of `Model.evaluate()` and `Model.predict()` to `"auto"`, which defaults to `verbose=1` for most cases and defaults to `verbose=2` when used with `ParameterServerStrategy` or with interactive logging disabled.
* Argument `jit_compile` in `Model.compile()` now applies to `Model.evaluate()` and `Model.predict()`. Setting `jit_compile=True` in `compile()` compiles the model's training, evaluation, and inference steps to [XLA](https://www.tensorflow.org/xla). Note that `jit_compile=True` may not necessarily work for all models.
* Added DTensor-related Keras APIs under `tf.keras.dtensor` namespace. The APIs are still classified as experimental. You are welcome to try it out. Please check the tutoral and guide on https://www.tensorflow.org/ for more details about DTensor.


What's Changed
* Update_OptimizerV2.py by sachinprasadhs in https://github.com/keras-team/keras/pull/15819
* Use `assign_sub` when computing `moving_average_update` by lgeiger in https://github.com/keras-team/keras/pull/15773
* Document the verbose parameter in EarlyStopping by ThunderKey in https://github.com/keras-team/keras/pull/15817
* Fix LSTM and GRU cuDNN kernel failure for RaggedTensors. by foxik in https://github.com/keras-team/keras/pull/15756
* A tiny problem in an AttributeError message in base_layer.py by Aujkst in https://github.com/keras-team/keras/pull/15847
* Update training_generator_test.py by sachinprasadhs in https://github.com/keras-team/keras/pull/15876
* Minor correction in RegNet docs by AdityaKane2001 in https://github.com/keras-team/keras/pull/15901
* add scoring methods in Luong-style attention by old-school-kid in https://github.com/keras-team/keras/pull/15867
* refactoring code with List Comprehension by idiomaticrefactoring in https://github.com/keras-team/keras/pull/15924
* added clarifying statement to save_model example text by soosung80 in https://github.com/keras-team/keras/pull/15930
* Update base_conv.py by AdityaKane2001 in https://github.com/keras-team/keras/pull/15943
* Update global_clipnorm by sachinprasadhs in https://github.com/keras-team/keras/pull/15938
* Update callbacks.py by Cheril311 in https://github.com/keras-team/keras/pull/15977
* Applied correct reshaping to metric func sparse_top_k by dfossl in https://github.com/keras-team/keras/pull/15997
* Keras saving/loading: Add a custom object saving test to verify the `keras.utils.register_keras_serializable` flows we are expecting users to follow work, and will continue to work with the new design and implementation coming in. by copybara-service in https://github.com/keras-team/keras/pull/15992
* Metric accuracy bug fixes - Metrics Refactor proposal by dfossl in https://github.com/keras-team/keras/pull/16010
* Make `classifier_activation` argument accessible for DenseNet and NASNet models by adrhill in https://github.com/keras-team/keras/pull/16005
* Copy image utils from keras_preprocessing directly into core keras by copybara-service in https://github.com/keras-team/keras/pull/15975
* Update `keras.callbacks.BackupAndRestore` docs by lgeiger in https://github.com/keras-team/keras/pull/16018
* Updating the definition of an argument in the text_dataset_from_directory function by shraddhazpy in https://github.com/keras-team/keras/pull/16012
* Remove deprecated TF1 Layer APIs `apply()`, `get_updates_for()`, `get_losses_for()`, and remove the `inputs` argument in the `add_loss()` method. by copybara-service in https://github.com/keras-team/keras/pull/16046
* Fixed minor typos by hdubbs in https://github.com/keras-team/keras/pull/16071
* Fix typo in documentation by futtetennista in https://github.com/keras-team/keras/pull/16082
* Issue 16090: Split input_shapes horizontally in utils.vis_utils.plot_model by RicardFos in https://github.com/keras-team/keras/pull/16096
* Docker env setup related changes by shraddhazpy in https://github.com/keras-team/keras/pull/16040
* Fixed EfficientNetV2 b parameter not increasing with each block. by sebastian-sz in https://github.com/keras-team/keras/pull/16145
* Updated args of train_on_batch method by jvishnuvardhan in https://github.com/keras-team/keras/pull/16147
* Binary accuracy bug fixes - Metric accuracy method refactor by dfossl in https://github.com/keras-team/keras/pull/16083
* Fix the corner case for dtensor model layout map. by copybara-service in https://github.com/keras-team/keras/pull/16170
* Fix typo in docstring for `DenseFeatures` by gadagashwini in https://github.com/keras-team/keras/pull/16165
* Fix typo in Returns Section by chunduriv in https://github.com/keras-team/keras/pull/16182
* Some tests misusing assertTrue for comparisons fix by code-review-doctor in https://github.com/keras-team/keras/pull/16073
* Add .DS_Store to .gitignore for macOS users by tsheaff in https://github.com/keras-team/keras/pull/16198
* Solve memory inefficiency in RNNs by atmguille in https://github.com/keras-team/keras/pull/16174
* Update README.md by ahmedopolis in https://github.com/keras-team/keras/pull/16259
* Fix documentation text being mistakenly rendered as code by guberti in https://github.com/keras-team/keras/pull/16253
* Allow single input for merging layers Add, Average, Concatenate, Maximum, Minimum, Multiply by foxik in https://github.com/keras-team/keras/pull/16230
* Mention image dimensions format in image_dataset_from_directory by nrzimmermann in https://github.com/keras-team/keras/pull/16232
* fix thresholded_relu to support list datatype by old-school-kid in https://github.com/keras-team/keras/pull/16277
* Implement all tf interpolation upscaling methods by Mahrkeenerh in https://github.com/keras-team/keras/pull/16249

New Contributors
* lgeiger made their first contribution in https://github.com/keras-team/keras/pull/15773
* ThunderKey made their first contribution in https://github.com/keras-team/keras/pull/15817
* Aujkst made their first contribution in https://github.com/keras-team/keras/pull/15847
* idiomaticrefactoring made their first contribution in https://github.com/keras-team/keras/pull/15924
* soosung80 made their first contribution in https://github.com/keras-team/keras/pull/15930
* Cheril311 made their first contribution in https://github.com/keras-team/keras/pull/15977
* dfossl made their first contribution in https://github.com/keras-team/keras/pull/15997
* adrhill made their first contribution in https://github.com/keras-team/keras/pull/16005
* shraddhazpy made their first contribution in https://github.com/keras-team/keras/pull/16012
* hdubbs made their first contribution in https://github.com/keras-team/keras/pull/16071
* futtetennista made their first contribution in https://github.com/keras-team/keras/pull/16082
* RicardFos made their first contribution in https://github.com/keras-team/keras/pull/16096
* gadagashwini made their first contribution in https://github.com/keras-team/keras/pull/16165
* chunduriv made their first contribution in https://github.com/keras-team/keras/pull/16182
* code-review-doctor made their first contribution in https://github.com/keras-team/keras/pull/16073
* tsheaff made their first contribution in https://github.com/keras-team/keras/pull/16198
* atmguille made their first contribution in https://github.com/keras-team/keras/pull/16174
* ahmedopolis made their first contribution in https://github.com/keras-team/keras/pull/16259
* guberti made their first contribution in https://github.com/keras-team/keras/pull/16253
* nrzimmermann made their first contribution in https://github.com/keras-team/keras/pull/16232
* Mahrkeenerh made their first contribution in https://github.com/keras-team/keras/pull/16249

**Full Changelog**: https://github.com/keras-team/keras/compare/v2.8.0-rc0...v2.9.0-rc0

Please see the release history at https://github.com/tensorflow/tensorflow/releases/tag/v2.8.0 for more details.