Morl-baselines

Latest version: v1.1.0

Safety actively analyzes 681812 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

1.1.0

What's Changed
* Move util functions to make more sense by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/62
* Implement fast pareto and convex hull pruning by wilrop in https://github.com/LucasAlegre/morl-baselines/pull/60
* Support Gymnasium 0.29 by LucasAlegre in https://github.com/LucasAlegre/morl-baselines/pull/64
* Add minecart-deterministic-v0 to envs with known pfs by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/65
* Support for image-based observations in GPI-LS and Envelope by LucasAlegre in https://github.com/LucasAlegre/morl-baselines/pull/63
* Implement a fix to 69 by wilrop in https://github.com/LucasAlegre/morl-baselines/pull/70
* Feature/hpo by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/74
* Use deterministic policies when evaluating PCN by vaidas-sl in https://github.com/LucasAlegre/morl-baselines/pull/75
* Add bibtex for NeurIPS paper by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/77
* Update README.md by eltociear in https://github.com/LucasAlegre/morl-baselines/pull/80
* Log all training parameters given to the algorithm by wilrop in https://github.com/LucasAlegre/morl-baselines/pull/83
* Add support for continuous action spaces to PCN by vaidas-sl in https://github.com/LucasAlegre/morl-baselines/pull/82
* Fix bug where tolist was called on a float by wilrop in https://github.com/LucasAlegre/morl-baselines/pull/86
* Adding cardinality metric by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/87
* Remove dropout at evaluation time on GPI-LS by LucasAlegre in https://github.com/LucasAlegre/morl-baselines/pull/90
* MORL/D by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/89
* Chore/remove tensorboard stuff make gym logging optional by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/94
* Make number of sampled weights used to compute utility metrics parameterizable by LucasAlegre in https://github.com/LucasAlegre/morl-baselines/pull/95
* Dev eupg by omidsbhn in https://github.com/LucasAlegre/morl-baselines/pull/99
* Fix PGMORL example by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/104
* Bump actions/download-artifact from 2 to 4.1.7 in /.github/workflows by dependabot in https://github.com/LucasAlegre/morl-baselines/pull/116
* Fix EUPG's inconsistent expansion of observations by timondesch in https://github.com/LucasAlegre/morl-baselines/pull/119
* Migration to gymnasium 1.0 by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/109
* Add save_freq option to CAPQL train method by LucasAlegre in https://github.com/LucasAlegre/morl-baselines/pull/122
* In GPI-LS for continuous action, use GPI only for selecting weights as default by LucasAlegre in https://github.com/LucasAlegre/morl-baselines/pull/126
* Add python 3.12 support by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/125

New Contributors
* vaidas-sl made their first contribution in https://github.com/LucasAlegre/morl-baselines/pull/75
* eltociear made their first contribution in https://github.com/LucasAlegre/morl-baselines/pull/80
* omidsbhn made their first contribution in https://github.com/LucasAlegre/morl-baselines/pull/99
* dependabot made their first contribution in https://github.com/LucasAlegre/morl-baselines/pull/116
* timondesch made their first contribution in https://github.com/LucasAlegre/morl-baselines/pull/119

**Full Changelog**: https://github.com/LucasAlegre/morl-baselines/compare/1.0.0...v1.1.0

1.0.0

This release marks the first stable version of MORL-Baselines. After having thoroughly tested the algorithms on various environments fixing bugs for the past few weeks. We feel the library is stable enough to deserve a proper release.

Features
* Over 10 MORL algorithms supported under the [MO-Gymnasium](https://mo-gymnasium.farama.org/) API (multi & single policy, under SER and ESR criteria);
* Automated reporting to [Weights and Biases](https://wandb.ai/home) dashboards... of various metrics (see screenshot below);
* Clean, documented, and tested code, and this is enforced by our CI hooks;
* Utility functions to help researchers build new algorithms, e.g. `ParetoArchive`, `NatureCNN`, `PrioritizedReplayBuffer`;
* Performances have been tested and reported in a reproducible manner: see 43 and https://wandb.ai/openrlbenchmark/MORL-Baselines.

Example of our dashboards: Pareto front and multi-objective metrics are visible in real-time.
<img width="1904" alt="wandb" src="https://github.com/LucasAlegre/morl-baselines/assets/11799929/961f8418-578b-493a-ad28-2e9ec9df085c">

1.0.0rc2

What's Changed
* Change PQL to linearly decaying exploration by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/48
* Refactor random seed by LucasAlegre in https://github.com/LucasAlegre/morl-baselines/pull/49
* Recover from solver error in OLS by ffelten in https://github.com/LucasAlegre/morl-baselines/pull/51


**Full Changelog**: https://github.com/LucasAlegre/morl-baselines/compare/1.0.0-rc1...1.0.0-rc2

1.0.0rc1

First release candidate aiming at stabilizing and reporting the performances of the algorithms in the codebase. We aim to fix bugs as we encounter them when assessing performances and bumping RC numbers along the way. Once we have finished the performance assessments, we should be able to release 1.0.0.

Links

Releases

Has known vulnerabilities

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.