Mle-hyperopt

"end": 0.5,
"prior": "log-uniform"}},
integer={"batch_size": {"begin": 32,
"end": 128,
"prior": "uniform"}},
categorical={"arch": ["mlp", "cnn"]})

Simple ask - eval - tell API
configs = strategy.ask(5)
values = [train_network(**c) for c in configs]
strategy.tell(configs, values)


- Different search strategies: Grid, random, SMBO, base nevergrad

- Fix rounding and numpy version

Fixed
- Fix `MutableMapping` to also work with python 3.10.
- Fix `pickle5` install requirement to only apply for python < 3.8

Fixed
- Minor fixes for broken `scikit-optimize` dependency.

Added
- Log reloading helper for post-processing.

Fixed
- Bug fix in `mle-search` with imports of dependencies. Needed to append path.
- Bug fix with cleaning nested dictionaries. Have to make sure not to delete entire sub-dictionary.

Added

- Adds a command line interface for running a sequential search given a python script `<script>.py` containing a function `main(config)`, a default configuration file `<base>.yaml` & a search configuration `<search>.yaml`. The `main` function should return a single scalar performance score. You can then start the search via:


mle-search <script>.py --base_config <base>.yaml --search_config <search>.yaml --num_iters <search_iters>

Or short via:

mle-search <script>.py -base <base>.yaml -search <search>.yaml -iters <search_iters>

- Adds doc-strings to all functionalities.
Changed

- Make it possible to optimize parameters in nested dictionaries. Added helpers `flatten_config` and `unflatten_config`. For shaping `'sub1/sub2/vname' <-> {sub1: {sub2: {vname: v}}}`
- Make start-up message also print fixed parameter settings.
- Cleaned up decorator with the help of `Strategies` wrapper.