Keras-hub

Summary

This release adds support for running KerasNLP against Keras 3. You can try this today by installing `tf-nightly` and `tensorflow-text-nightly`.

shell
pip install keras-nlp
pip uninstall -y tensorflow-text tensorflow keras
pip install tensorflow-text-nightly tf-nightly


Otherwise, this release should be a no-op for all users. No new features, no change in default behavior.

Upcoming changes

After the release of Keras 3, we will drop support for running KerasNLP against the Keras Core package (no more `import keras_core as keras`), in favor of Keras 3. Keras 3 is the long-term replacement for Keras Core.

What's Changed
* Cherry picks for 0.6.3 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1297
* Version bump 0.6.3 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1298
* Bump the version to 0.6.3.dev1 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1301
* Version bump to 0.6.3 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1302


**Full Changelog**: https://github.com/keras-team/keras-nlp/compare/v0.6.2...v0.6.3

Summary
* Support mixed precision on keras-core on all of jax, torch and tensorflow.
* Add `keras_nlp.layers.RotaryEmbedding` for rotary embeddings.
* Add `keras_nlp.layers.ReversibleEmbedding` to better support tied or untied weights for logit projections.
* Many bug fixes and improvements.

What's Changed
* Generic `RotaryEmbedding` Layer by shivance in https://github.com/keras-team/keras-nlp/pull/1180
* Raise ValueError when number of dims evaluate to zero by sampathweb in https://github.com/keras-team/keras-nlp/pull/1198
* Add XLNetBackbone by susnato in https://github.com/keras-team/keras-nlp/pull/1084
* Switch from tf.nest to dm-tree by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1199
* Fix CI for keras-core 0.1.4 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1202
* Fix ModuleNotFoundError `keras_nlp.models.xlnet` by shivance in https://github.com/keras-team/keras-nlp/pull/1204
* Add support for "untied" embedding weights in language models by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1201
* Add start_index argument to all position embedding layers by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1209
* Remove windows line endings by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1210
* Fix Autograph error with perplexity metric by shivance in https://github.com/keras-team/keras-nlp/pull/1211
* [JAX backend]: Fix errors with perplexity by shivance in https://github.com/keras-team/keras-nlp/pull/1213
* Improve layer naming consistency by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1219
* Stop asserting key order in bart preprocessor by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1221
* Remove file level docstrings by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1222
* Fix typos by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1220
* Typo fix by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1223
* Fix RotaryEmbedding import by shivance in https://github.com/keras-team/keras-nlp/pull/1217
* Update transformer_decoder for the proper naming of the sublayers. by qlzh727 in https://github.com/keras-team/keras-nlp/pull/1230
* Replace tf with numpy by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1232
* Update to always using ops.shape by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1231
* Add a test harness based on keras-core's `run_layer_test` by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1238
* fixed token_to_id doc + error msg by jackd in https://github.com/keras-team/keras-nlp/pull/1240
* Changed default TokenAndPositionEmbedding initializer to 'uniform' by jackd in https://github.com/keras-team/keras-nlp/pull/1237
* Add compat shims for the upcoming keras-core release by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1244
* Depend on latest keras-core by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1246
* Removed the undefined self.sequence_length by sahusiddharth in https://github.com/keras-team/keras-nlp/pull/1245
* Bump devcontainer to 3.9 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1249
* Add a mixed precision test and fix mixed precision errors for layers by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1242
* Quick fix for 0.1.7 keras-core release by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1251
* Small docstring fixes for the upcoming release by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1253

New Contributors
* qlzh727 made their first contribution in https://github.com/keras-team/keras-nlp/pull/1230
* jackd made their first contribution in https://github.com/keras-team/keras-nlp/pull/1240
* sahusiddharth made their first contribution in https://github.com/keras-team/keras-nlp/pull/1245

**Full Changelog**: https://github.com/keras-team/keras-nlp/compare/v0.6.1...v0.6.2

With the 0.6.1. release, all remaining models, metrics and samplers have been ported to [keras-core](https://keras.io/keras_core/). The full KerasNLP API is now available on TensorFlow, PyTorch and Jax ([instructions](https://github.com/keras-team/keras-nlp#using-kerasnlp-with-keras-core)).

Summary
* FNet and DeBERTa are now multi-backend.
* All `keras_nlp.models.FNetXX` and `keras_nlp.models.DebertaV3XX` symbols work on all backends.
* `keras_nlp.samplers.BeamSampler` and `keras_nlp.samplers.ContrastiveSampler` work on all backends.
* All `keras_nlp.metrics` classes work on all backends.
* For Jax and PyTroch, pass python strings to metrics (as tensor strings are strictly tensorflow).
* Restored the `mask_positions` named argument to `MaskedLMHead`.

What's Changed
* Update README for Keras Core by jbischof in https://github.com/keras-team/keras-nlp/pull/1135
* Ignore errors in UTF-8 decoding by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1150
* Ports GPTNeoX to KerasCore by shivance in https://github.com/keras-team/keras-nlp/pull/1137
* Small fix for mixed precision generation on tf by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1153
* Port DeBERTa to multi-backend by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1155
* Change all tensors passed to tf.data.Dataset to numpy by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1161
* Fix broken tests by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1163
* Pin keras-core to 0.1.0 while investigating failures by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1168
* Run GPU tests on Jax + Torch by ianstenbit in https://github.com/keras-team/keras-nlp/pull/1160
* Fix flakes in masked lm testing by removing any indeterminism by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1171
* Always install the correct version with pip_build by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1174
* Remove tests for preprocessing inside a functional model by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1175
* Extend the timeout for large tests by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1103
* Add `GPTNeoXCausalLM` by shivance in https://github.com/keras-team/keras-nlp/pull/1110
* Bump tensorflow to latest stable by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1170
* Add compute_output_shape to tokenizer by shivance in https://github.com/keras-team/keras-nlp/pull/1166
* Stop pinning keras-core by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1178
* Port FNet by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1164
* Automate the update image flow by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1179
* Restore mask_position argument name by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1185
* Port contrastive sampler to multi-backend by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1187
* Port `BeamSampler` to core by shivance in https://github.com/keras-team/keras-nlp/pull/1181
* Port metrics to multi-backend by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1186

New Contributors
* ianstenbit made their first contribution in https://github.com/keras-team/keras-nlp/pull/1160

**Full Changelog**: https://github.com/keras-team/keras-nlp/compare/v0.6.0...v0.6.1

KerasNLP is adding experimental support for Jax and PyTorch backends on top of the **Keras Core** library. Read the [anouncement](https://keras.io/keras_core/announcement/), and browse the [full library documentation](http://keras.io/keras_core/), including how to specify the backend when running your code.

Support for both Jax and PyTorch is still experimental, expect some rough edges and please give us feedback!

Summary
* This release should be equivalent to `0.5.2` with the addition of multi-backend support.
* The following API symbols are currently restricted to the tensorflow backend:
* `keras_nlp.models.DebertaV3*`
* `keras_nlp.models.FNet*`
* `keras_nlp.metrics`
* `keras_nlp.samplers.BeamSampler`
* `keras_nlp.samplers.ContrastiveSampler`
* Note that there are two ways you can run on top of Tensorflow.
* If you run your scripts/colab without any changes, KerasNLP will use **tf.keras** for all layer and modeling implementations. This should be a no-op from previous releases of the library.
* If you run your scripts/colab with `KERAS_BACKEND={jax, torch, tensorflow}`, you will be trying the new **Keras Core** library, using the specified backend. This is a great way to test out the future of the library!
* Full details on runtime specification is available along with the [Keras Core documentation](http://keras.io/keras_core/).

What's Changed
* small updates to the release doc by chenmoneygithub in https://github.com/keras-team/keras-nlp/pull/1031
* Sampler docstring edit by abuelnasr0 in https://github.com/keras-team/keras-nlp/pull/1033
* Fix program crash for id_to_token() method in SentencePieceTokenizer by abuelnasr0 in https://github.com/keras-team/keras-nlp/pull/1040
* Update our release process to preview docs before release by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1043
* Add Whisper Tokenizer and Audio Feature Extractor by abheesht17 in https://github.com/keras-team/keras-nlp/pull/847
* Also strip padding token for opt by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1028
* Add regex dep by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1044
* Add BartSeq2SeqLM and conditional text generation with BART by abheesht17 in https://github.com/keras-team/keras-nlp/pull/974
* Support list/tuple inputs for special tokens in StartEndPacker layer by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1045
* Support list/tuple inputs for special tokens in MultiSegmentPacker layer by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1046
* Fix a misleading part of our cached MHA docs by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1048
* Always pass weight name by kwarg by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1053
* Always pass metrics in a list or dict by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1054
* Move `Defaults to` to end of arg docstring and standardise values by SamuelMarks in https://github.com/keras-team/keras-nlp/pull/1057
* Fix beam search for BART by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1058
* Replace tf.dtype with "dtype" by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1059
* Test shapes directly by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1064
* Clean up metrics tests by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1063
* Remove metrics merge tests by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1065
* Fix whisper feature inputs by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1069
* Always specify shape when creating variables by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1067
* Remove ragged support from position embeddings by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1068
* Clean up dtype handling for preprocessing layers by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1066
* Add BART finetuned on CNN+DM for summarisation by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1060
* Fix saving bug by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1073
* Fix t5 forward pass by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1082
* Feat/make transformer decoder callable without causal mask by ferraric in https://github.com/keras-team/keras-nlp/pull/1083
* Adding `GPTNeoXBackbone` by shivance in https://github.com/keras-team/keras-nlp/pull/1056
* Add a common test case by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1095
* Update register_keras_serializable to use saving module by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1094
* Don't test tf format by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1104
* Add `GPTNeoXPreprocessor` by shivance in https://github.com/keras-team/keras-nlp/pull/1093
* Split layers into layers/modeling & layers/preprocessing by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1102
* Fix merge conflict from 1102 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1105
* Add a common base class for generative models by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1096
* Add `GPTNeoXCausalLMPreprocessor` by shivance in https://github.com/keras-team/keras-nlp/pull/1106
* Add Whisper Presets by abheesht17 in https://github.com/keras-team/keras-nlp/pull/1089
* Refactor `RotaryEmbedding` and `GPTNeoXAttention` by shivance in https://github.com/keras-team/keras-nlp/pull/1101
* Remove all the secret keys for ci by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1126
* Fix publish to pypi action by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1127
* Unexport models that are not in the 0.6 release by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1125
* Bump the version to 0.6.0 by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1128

New Contributors
* SamuelMarks made their first contribution in https://github.com/keras-team/keras-nlp/pull/1057
* ferraric made their first contribution in https://github.com/keras-team/keras-nlp/pull/1083

**Full Changelog**: https://github.com/keras-team/keras-nlp/compare/v0.5.2...v0.6.0

What's Changed
* Fix unclosed fenced docstrings by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1025
* Fix a bug with computing the output mask after generate by mattdangerw in https://github.com/keras-team/keras-nlp/pull/1029


**Full Changelog**: https://github.com/keras-team/keras-nlp/compare/v0.5.1...v0.5.2

What's Changed
* Fix typos in export by chenmoneygithub in https://github.com/keras-team/keras-nlp/pull/1024


**Full Changelog**: https://github.com/keras-team/keras-nlp/compare/v0.5.0...v0.5.1