Merlin-models

What’s Changed

🐜 Bug Fixes

- Fix BroadcastToSequence to enable context features in sequential models gabrielspmoreira (991)
- Fixes lower train metrics when using Keras Masking (SequenceMaskRandom, SequenceMaskLast) gabrielspmoreira (983)
- Makes ColumnBasedSampleWeight serializable gabrielspmoreira (979)
- fix training a sequential model with AverageEmbeddingsByWeightFeature sararb (973)
- Fixes support of sequential continuous features for sequential and non-sequential models gabrielspmoreira (969)
- add get_config() to AverageEmbeddingsByWeightFeature class rnyak (968)

🚀 Features

- Fixes support of sequential continuous features for sequential and non-sequential models gabrielspmoreira (969)
- add get_config() to AverageEmbeddingsByWeightFeature class rnyak (968)

📄 Documentation

- enhancing the next-item prediction notebook documentation MarkMoTrin (975)
- Update 05-Retrieval-Model.ipynb al-yakubovich (967)

🔧 Maintenance

- enhancing the next-item prediction notebook documentation MarkMoTrin (975)
- Remove Notebook Output before running pre-commit lint checks oliverholworthy (984)
- fix gpu visibility with env passthrough jperez999 (976)

What’s Changed

🐜 Bug Fixes

- Fix the inference of transformer-based models trained with masked language modeling sararb (909)
- Making InputBlockV2(..., embeddings) deprecated and adjusting tests to use categorical arg gabrielspmoreira (880)
- Preventing silent error when evaluating V1 retrieval models (TwoTower, MF) gabrielspmoreira (892)
- Fix loading of `TwoTowerModel` with context query variable oliverholworthy (887)
- Enable `sequence-testing` synthetic data to be generated with different sequence lengths oliverholworthy (882)
- Enable concat of sequence features with `InputBlockV2` oliverholworthy (883)
- Make path optional in get_booking marcromeyn (874)
- fix dtype error due to date column in ecommerce-session-based-next-item-prediction-for-fashion nb rnyak (921)
- Fix the serialization of SequenceSummary block sararb (927)
- Use tf.function for list column operations edknv (938)

🚀 Features

- Save output schema of model and add save method to `Encoder` oliverholworthy (886)
- Add the support of different thresholds k in the TopkEncoder sararb (869)

📄 Documentation

- Update retrieval notebook to new api rnyak (900)
- Add Reference to Transformer4Rec for PyTorch support `bschifferer` (903)
- docs: Add calver to semver banner mikemckiernan (865)
- docs: Add basic SEO configuration mikemckiernan (864)
- update drafter to work on tags only and update cpu ci to target branch jperez999 (901)
- Session-based example using dressipi dataset and XLNet architecture rnyak (849)
- Adding Multi-GPU Data Parallel Example bschifferer (855)
- T4rec use case radekosmulski (853)
- Do not copy source to docs output mikemckiernan (888)

🔧 Maintenance

- Support `tuple` return type from model `pre` and update test to use this oliverholworthy (890)
- Use merlin-dataloader package edknv (845)
- update drafter to work on tags only and update cpu ci to target branch jperez999 (901)
- Add skip if transformers not available for next item prediction notebook test oliverholworthy (899)
- Skip retrieval_with_hpo notebook test when optuna is not installed edknv (897)
- Update test of lazy adam notebook to only run when GPU available oliverholworthy (894)
- Remove tensorflow dependencies from `requirements/dev.txt` oliverholworthy (895)
- Add test for retrieval model with transformer block oliverholworthy (833)
- Pin fiddle to 0.2.2 so that tests run with pip install oliverholworthy (872)
- Pass task="binary" to binary metrics to handle latest torchmetrics oliverholworthy (920)
- Publish Release Draft on release branch builds oliverholworthy (925)
- Update branch name extraction for tag builds oliverholworthy (972)

**Full Changelog**: https://github.com/NVIDIA-Merlin/models/compare/v0.10.0...v0.11.0

What’s Changed

🐜 Bug Fixes

- Enable concat of sequence features with `InputBlockV2` oliverholworthy (883)
- Make path optional in get_booking marcromeyn (874)

📄 Documentation

- T4rec use case radekosmulski (853)
- Do not copy source to docs output mikemckiernan (888)
🔧 Maintenance

- Skip retrieval_with_hpo notebook test when optuna is not installed edknv (897)
- Update test of lazy adam notebook to only run when GPU available oliverholworthy (894)
- Remove tensorflow dependencies from `requirements/dev.txt` oliverholworthy (895)
- Add test for retrieval model with transformer block oliverholworthy (833)
- Pin fiddle to 0.2.2 so that tests run with pip install oliverholworthy (872)

What’s Changed

🐜 Bug Fixes

- Quick fix to parse post in transformer when a string is passed in marcromeyn (832)
- Trying to add Bokeh to dev-requirements to fix failing xgb-tests marcromeyn (839)
- Ensure metrics passed to `model.compile()` are always reset sararb (830)
- Fix `EmbeddingFeatures` serialization/deserialization when a feature is named 'name' oliverholworthy (817)
- Add support for LogitsTemperatureScaler in the new ModelOutput API sararb (815)
- Add LogQ correction support to the new ModelOutput API sararb (811)

🚀 Features

- Removing mask from PredictionContext, since it's unused marcromeyn (838)
- Add `seed` to `TopKMetric` for consistent metrics when ties in ranking oliverholworthy (827)
- Adding SequenceSummary transforms for transformers marcromeyn (828)
- [Test] - fix pretrained embedding unittest bschifferer (826)
- Making sure InputBlockV2 works without the precense of categorical-features marcromeyn (821)
- fix OOM issue in accelerate-training-of-large-embedding-tables-by-LazyAdam nb unit test rnyak (816)
- Add L2-batch regularization to EmbeddingTable sararb (812)

🔧 Maintenance

- fix OOM issue in accelerate-training-of-large-embedding-tables-by-LazyAdam nb unit test rnyak (816)
- update temp data paths in example notebooks nv-alaiacano (813)
- Use pytest-xdist with tensorflow tests to reduce running time of tests oliverholworthy (795)
- Add `python_requires` specifying 3.8 as minimum Python version oliverholworthy (797)

What’s Changed

⚠ Breaking Changes

- Add loader transforms edknv (740)
- Move transformation-layers to sub package marcromeyn (710)

🐜 Bug Fixes

- Bug when predicting with list-column marcromeyn (758)
- Fix saving + reloading models with ContrastiveOutput marcromeyn (757)
- Fixed inconsistency on multi-task learning metrics due to a mismatch or tasks and metrics order gabrielspmoreira (751)
- Implement `on_epoch_end` method on `BatchedDataset` oliverholworthy (724)
- Fixes RegressionTask which was raising an error because compute_output_shape() was not defined gabrielspmoreira (741)

🚀 Features

- Return correct type from data augmentation layer depending on the context oliverholworthy (703)
- Add test for `TwoTowerModel` with `InputBlockV2` and `Embeddings` oliverholworthy (759)
- XGBoost - Use DaskDMatrix for evals data to ensure metrics in logs match result of evaluate oliverholworthy (682)
- Add `BroadcastToSequence` Layer to broadcast context features to match sequence shapes. oliverholworthy (737)
- Fix saving + reloading models with ContrastiveOutput marcromeyn (757)
- Add select_by_tag to ParallelBlock edknv (701)
- Add loader transforms edknv (740)
- Making InputBlockV2 more generic marcromeyn (754)
- Example notebook of Wide&Deep model gabrielspmoreira (716)
- Introducing Outputs-V2 marcromeyn (715)
- Move transformation-layers to sub package marcromeyn (710)
- Add EncoderBlock marcromeyn (705)

📄 Documentation

- Fix Feature Engineering Dressipi bschifferer (723)

🔧 Maintenance

- Improve reliability of `test_train_metrics_steps` with a custom test metric oliverholworthy (766)
- Remove `cluster_type` from `dask_client` test fixture oliverholworthy (763)
- Update tensorflow version test matrix version specifiers for clarity oliverholworthy (726)
- Update `ItemRetrievalScorer` to use tf_inspect to get call args oliverholworthy (756)
- Added InputBlockV2 support to DeepFMModel (refactored and fixed) and DCNModel gabrielspmoreira (717)

What’s Changed

🐜 Bug Fixes

- Fix ecommerce session based test edknv (690)
- Add `dtype` conversion for continuous columns in synthetic data generation oliverholworthy (662)
- Breaks ties of top-k metrics gabrielspmoreira (653)
- Enable saving of TwoTowerModel oliverholworthy (615)
- Update stacking in `DLRMBlock` to use correct axis for the dot product. oliverholworthy (637)
- Fix lightfm evaluate code benfred (616)
- Enable predict in XGBoost without targets in provided dataset oliverholworthy (612)
- Use labels instead of predictions in XGBoost eval data karlhigley (610)
- Stop reordering columns in merlin.models.xgb.dataset_to_xy radekosmulski (603)

🚀 Features

- Extend `EmbeddingTable` and `Embeddings` with support for shared embeddings oliverholworthy (700)
- Filter features in ParallelBlock edknv (686)
- Improvements in Wide and Deep architecture timmy00 (638)
- Add CategoryEncoding transformation block timmy00 (614)
- Add Layer freezing timmy00 (635)
- Add `save` and `load` methods to XGBoost class oliverholworthy (656)
- Restructuring Embeddings marcromeyn (649)
- enhance pretrained-embeddings example to set trainable=False for the pre-trained embeddings rnyak (654)
- Tf/categorical prediction v2 sararb (633)
- Enable customization of embeddings in DLRM Model oliverholworthy (619)
- Add `trainable` and `embeddings_initializers` args to `Embeddings` function rnyak (634)
- Add Wide Deep model timmy00 (623)
- Enable static weights to be used with `EmbeddingTable.from_pretrained` oliverholworthy (632)
- Enable `TabularData` to be used with `EmbeddingTable` oliverholworthy (631)
- Add LazyAdam optimizer timmy00 (602)
- Tf/contrastive prediction marcromeyn (594)
- Hashed Crosses for all levels timmy00 (590)
- Supports task-specific sample weights, weighed_metrics and fixes InputBlockV2 gabrielspmoreira (600)
- Introducing new base-implementations to replace prediction-tasks marcromeyn (589)
- Add multi optimizer timmy00 (581)
- Introducing MapValues marcromeyn (591)
- Fix CategoricalOneHot with compute_output_shape and check inputs. timmy00 (597)
- Add EmbeddingOptions arg in the DLRM block rnyak (592)
- Decoupling of InputBlock(v2) and Embedding Tables, support to Ragged Embeddings Lookup and AverageEmbeddingsByWeightFeature gabrielspmoreira (593)

📄 Documentation

- update logo usecase bschifferer (693)
- [WIP] Add Dressipi RecSys Util Function to Merlin Models bschifferer (664)
- update 01-Getting-started radekosmulski (671)
- update logos for example notebooks 02 - 06 radekosmulski (672)
- add tracking logo to examples/07 radekosmulski (661)
- Add lightfm and implicit training examples radekosmulski (629)

🔧 Maintenance

- Separate the `dev` and `docs` requirements karlhigley (708)
- Fix ecommerce session based test edknv (690)
- Add `dtype` conversion for continuous columns in synthetic data generation oliverholworthy (662)
- Add unit test for the trainable embeddings func rnyak (648)
- Update `versioneer` from 0.20 to 0.23 oliverholworthy (646)
- Remove `-e` from pip install commands in github workflows oliverholworthy (645)
- Trying to make model unit-tests faster marcromeyn (595)