Renate

Minor release that upgrades versions of sagemaker, requests, Pillow, and transformers to account for vulnerabilities.

Minor release that changes versions of Pillow and transformers library to account for untrusted data vulnerability in transformers<4.36.0 and arbitrary code execution in Pillow<10.2.0.

🤩 Highlights
In this release we focused on the addition of methods for continual learning that do not require storing data in memory. In particular, we implemented methods that can work in combination with pre-trained transformer models.

🌟 New Features
* Logging additional metrics by prabhuteja12 in https://github.com/awslabs/Renate/pull/448
* S-Prompts for ViT and Text Transformers by prabhuteja12 in https://github.com/awslabs/Renate/pull/388

🛢 Datasets
* Adding CDDB dataset by prabhuteja12 in https://github.com/awslabs/Renate/pull/442
* Core50 dataset by prabhuteja12 in https://github.com/awslabs/Renate/pull/447

📜 Documentation Updates
* Documentation changes by prabhuteja12 in https://github.com/awslabs/Renate/pull/450

🐛 Bug Fixes
* CLEAR and TinyImageNet tests bugfixes by prabhuteja12 in https://github.com/awslabs/Renate/pull/441
* Fix CosineAnnealing issue in configs and add more configs by wistuba in https://github.com/awslabs/Renate/pull/449
* Fixing Issue of Avalanche Updater with Datasets that return PIL Images by wistuba in https://github.com/awslabs/Renate/pull/457
* Avoid In-Memory Dataset Copy for Avalanche by wistuba in https://github.com/awslabs/Renate/pull/463
* Update Flaky Tests by wistuba in https://github.com/awslabs/Renate/pull/495
* Speeding up unitests by prabhuteja12 in https://github.com/awslabs/Renate/pull/432


**Full Changelog**: https://github.com/awslabs/Renate/compare/v0.4.0...v0.5.0

🤩 Highlights
Renate 0.4.0 adds multi-gpu training via deepspeed, data shift detectors, L2P as a new updater, and a couple of new datasets for benchmarking (WildTimeData, CLEAR, DomainNet, 4TextDataset).

🌟 New Features
* MultiGPU training with deepspeed by prabhuteja12 in https://github.com/awslabs/Renate/pull/218
* Renate NLP Models and Benchmarking Support for Hugging Face by wistuba in https://github.com/awslabs/Renate/pull/213 https://github.com/awslabs/Renate/pull/233
* Covariate Shift Detectors by lballes: MMD (https://github.com/awslabs/Renate/pull/237), KS (https://github.com/awslabs/Renate/pull/242)
* New Updater: Learning to Prompt (L2P) by prabhuteja12 in https://github.com/awslabs/Renate/pull/367
* Upload custom files and folders with a SageMaker training Job by wistuba in https://github.com/awslabs/Renate/pull/286
* Custom Optimizer and LR schedulers by wistuba in https://github.com/awslabs/Renate/pull/290
* Flag to remove intermediate tasks' states by prabhuteja12 in https://github.com/awslabs/Renate/pull/289
* Make number of epochs "finetuning-equivalent" by lballes in https://github.com/awslabs/Renate/pull/344
* Add Micro Average Accuracy by wistuba in https://github.com/awslabs/Renate/pull/323
* Experimentation Tools by wistuba in https://github.com/awslabs/Renate/pull/356



🛢 Datasets
* Added 4 Wild Time Datasets by wistuba in https://github.com/awslabs/Renate/pull/187
* Enable CLEAR Datasets for Benchmarking by prabhuteja12 in https://github.com/awslabs/Renate/pull/287
* Add DomainNet Benchmark by wistuba in https://github.com/awslabs/Renate/pull/357
* Add benchmark made of multiple text datasets by 610v4nn1 in https://github.com/awslabs/Renate/pull/354
* MultiText dataset Added to Benchmarking by wistuba in https://github.com/awslabs/Renate/pull/366

📜 Documentation Updates
* Add doc page and example for shift detection by lballes in https://github.com/awslabs/Renate/pull/244
* Add example of using renate in your own script by lballes in https://github.com/awslabs/Renate/pull/274
* Describe Installation of Dependencies for Benchmarking by wistuba in https://github.com/awslabs/Renate/pull/313
* Improve title for the NLP example by 610v4nn1 in https://github.com/awslabs/Renate/pull/416




🐛 Bug Fixes
* Fix Offline-ER bug and change loss functions by wistuba in https://github.com/awslabs/Renate/pull/273
* Missing Argument Doesn't Allow for Remote Experiments by wistuba in https://github.com/awslabs/Renate/pull/304
* Fix Small Bug in Benchmarking Script and Add LR Scheduler to Experiment Config by wistuba in https://github.com/awslabs/Renate/pull/305
* Enable Downloading Large Files by wistuba in https://github.com/awslabs/Renate/pull/337
* Fix Scenario for CLEAR by wistuba in https://github.com/awslabs/Renate/pull/339
* Fix CLS-ER Loss by wistuba in https://github.com/awslabs/Renate/pull/347
* Fix weighting in OfflineER by lballes in https://github.com/awslabs/Renate/pull/355
* Fixing Bug with HPO by wistuba in https://github.com/awslabs/Renate/pull/345
* Adding a Datacollator to handle the wild time text datasets by prabhuteja12 in https://github.com/awslabs/Renate/pull/338
* Enable Offline-ER for NestedTensors by wistuba in https://github.com/awslabs/Renate/pull/336
* Refactor Offline-ER to work with `collate_fn` by wistuba in https://github.com/awslabs/Renate/pull/390
* Fixing the issue with Domainnet redownloading by prabhuteja12 in https://github.com/awslabs/Renate/pull/389
* CLEAR dataset download link update by prabhuteja12 in https://github.com/awslabs/Renate/pull/431
* Support Use of Joint and GDumb with Pre-Trained Models by wistuba in https://github.com/awslabs/Renate/pull/362




🏗️ Code Refactoring
* Remove obsolete `set_transforms` from memory buffer by lballes in https://github.com/awslabs/Renate/pull/265
* Missing dependency and problem with import by wistuba in https://github.com/awslabs/Renate/pull/272
* Using HuggingFace ViT implementation (219) by prabhuteja12 in https://github.com/awslabs/Renate/pull/303
* Introduce `RenateLightningModule` by wistuba in https://github.com/awslabs/Renate/pull/301
* Cleanup iCarl by wistuba in https://github.com/awslabs/Renate/pull/358
* Abstracting prompting transformer for use in L2P and S-Prompt by prabhuteja12 in https://github.com/awslabs/Renate/pull/420
* Adding flags to expose gradient clipping args in Trainer by prabhuteja12 in https://github.com/awslabs/Renate/pull/361
* Wild Time Benchmarks and Small Memory Hack by wistuba in https://github.com/awslabs/Renate/pull/363
* Clean Up Learner Checkpoint and Fix Model Loading by wistuba in https://github.com/awslabs/Renate/pull/365
* Enable Custom Grouping for DataIncrementalScenario by wistuba in https://github.com/awslabs/Renate/pull/368
* Masking of logits of irrelevant classes by prabhuteja12 in https://github.com/awslabs/Renate/pull/364
* Modifies current text transformer implementation to a RenateBenchmarkingModule by prabhuteja12 in https://github.com/awslabs/Renate/pull/380
* Replace memory batch size with a fraction of the total batch size by wistuba in https://github.com/awslabs/Renate/pull/359
* Make offline ER us total batch size in first update by lballes in https://github.com/awslabs/Renate/pull/381

🔧 Maintenance
* Robust Integration Tests by wistuba in https://github.com/awslabs/Renate/pull/214
* Update Renate Config Example by wistuba in https://github.com/awslabs/Renate/pull/226
* Longer Experiments for GPUs by wistuba in https://github.com/awslabs/Renate/pull/246
* Using `num_gpus_per_trial` after SyneTune update by prabhuteja12 in https://github.com/awslabs/Renate/pull/278
* Implementing a buffer that handles dataset elements of different sizes by prabhuteja12 in https://github.com/awslabs/Renate/pull/279
* Run sagemaker tests from GitHub Actions by wesk in https://github.com/awslabs/Renate/pull/275
* Fix Security Problem with `transformers` by wistuba in https://github.com/awslabs/Renate/pull/298


**Full Changelog**: https://github.com/awslabs/Renate/compare/v0.3.1...v0.4.0

What's Changed
* Adding a missing dependency and fixing a case where a conditional requirement was unnecessarily required by wistuba in https://github.com/awslabs/Renate/pull/284


**Full Changelog**: https://github.com/awslabs/Renate/compare/v0.3.0...v0.3.1

What's Changed
* **Covariate shift detection** by lballes (https://github.com/awslabs/Renate/pull/237, https://github.com/awslabs/Renate/pull/242, https://github.com/awslabs/Renate/pull/244). Shift detection may help users decide _when_ to update model. We now provide methods for covariate shift detection in `renate.shift`.
* **Wild Time benchmarking** by wistuba in https://github.com/awslabs/Renate/pull/187. Wild Time is a collection of datasets that exhibit temporal data distribution shifts. It is now available for benchmarking in Renate.
* **Improved NLP support** by wistuba (https://github.com/awslabs/Renate/pull/213, https://github.com/awslabs/Renate/pull/233). There's now a `RenateModule` for convenient usage of Hugging Face Transformers. NLP and models are now included in the benchmarking suite.
* Bug fixes and minor improvements.


**Full Changelog**: https://github.com/awslabs/Renate/compare/v0.2.1...v0.3.0