Optuna

This is the release note of v0.15.0. See [here](https://github.com/pfnet/optuna/milestone/11?closed=1) for the complete list of solved issues and merged PRs.

Compatibility
-------------
- Remove `FronzenTrial.params_in_internal_repr` field. (462)

Enhancements
------------
- Fix type hints and typo. (494, thanks c-bata!)
- Change types.py to type_checking.py. (492, thanks oda!)
- Reduce a query count of PercentilePruner and MedianPruner. (482, thanks c-bata!)
- Add empty distribution check. (473)
- Make `BaseStudy.storage` field private. (472)
- Reduce redundant code common to `Study` and `InTrialStudy`. (470)

Bug Fixes
---------
- Prevent TensorFlowPruningHook from reporting None. (481)
- Add NaN intermediate value handling to `TPESampler`. (476)

Documents
---------
- Fix typo in keras integration example. (488, thanks scouvreur!)
- Add `TPESampler` document. (474)
- Update `BaseSampler` document. (456)
- Add a tutorial page about user-defined sampler. (451)
- Set long_description in setup.py. (420, thanks c-bata!)

Examples
--------
- Add a simple Dask-ML example. (487, thanks AnesBenmerzoug!)
- Add a catboost example. (477, thanks scouvreur!)
- Add an example that implements simulated annealing based sampler. (446)

This is the release note of v0.14.0. See [here](https://github.com/pfnet/optuna/milestone/10?closed=1) for the complete list of solved issues and merged PRs.

New Features
------------
- Add CMA-ES Sampler. (447)

Enhancements
------------
- Make `TPESampler` faster. (466, thanks oda!)
- Add `intersection_search_space` function. (461)
- Change property access in TrialState for Python 3.4. (460)
- Change the default gamma function for `TPESampler`. (445)
- Make `TPESampler` pruning aware. (439)

Bug Fixes
---------
- Fix a bug when `suggest_categorical` is called with `choices` containing int and str. (449)

Documents
---------
- Fix typo in `cma.py` and `trial.py`. (463, thanks nmasahiro and c-bata!)

Examples
--------
- Apply maximize to examples. (410, thanks nmasahiro!)

Tests
-----
- Reduce CI time. (467)

This is the release note of v0.13.0. See [here](https://github.com/pfnet/optuna/milestone/9?closed=1) for the complete list of solved issues and merged PRs.

New Features
------------
- Introduce new sampler interface. (380)
- Add SkoptSampler. (399)

Compatibility
-------------
- Disable log propagation. (442)

Enhancements
------------
- Disable log propagation. (442)
- Add `BaseDistribution.single` methods. (431)
- Add `product_search_space` function. (430)
- Replace `connect_args` in `RDBStorage` constructor with `engine_kwargs` argument. (425)
- Support TensorFlow 1.14.0. (432)

Documents
---------
- Update README.md. (443)
- Add reference for distributions. (440)
- Add reference for BaseSampler. (437)
- Add reference for InTrialStudy. (436)

Examples
--------
- Add TensorFlow eager execution example. (369, thanks Rishav1!)

Highlights

Support user-defined Plotly objects

python
import optuna
from optuna_dashboard import save_plotly_graph_object

def objective(trial):
x = trial.suggest_float("x", -100, 100)
y = trial.suggest_categorical("y", [-1, 0, 1])
return x**2 + y

study = optuna.create_study()
study.optimize(objective, n_trials=100)
figure = optuna.visualization.plot_optimization_history(study)
save_plotly_graph_object(study, figure)


<img width="1961" alt="Screenshot 2023-09-07 10 42 05" src="https://github.com/optuna/optuna-dashboard/assets/5564044/3ff2ff30-abff-4afd-899f-45df22de2aa0">

What's Changed
* Update `errors.rst` about warnings of Artifact functionalities. by c-bata in https://github.com/optuna/optuna-dashboard/pull/549
* Add directions in CompareStudies by keisuke-umezawa in https://github.com/optuna/optuna-dashboard/pull/539
* Add `optuna_dashboard.preferential` module by c-bata in https://github.com/optuna/optuna-dashboard/pull/546
* Revert PR 534 that introduces codecov. by c-bata in https://github.com/optuna/optuna-dashboard/pull/554
* Add `.readthedocs.yml` by c-bata in https://github.com/optuna/optuna-dashboard/pull/556
* Remove `system_attrs` attributes from API response by c-bata in https://github.com/optuna/optuna-dashboard/pull/550
* Support 3dmodel artifacts by hrntsm in https://github.com/optuna/optuna-dashboard/pull/552
* Add `is_preferential` property to the study detail api response by c-bata in https://github.com/optuna/optuna-dashboard/pull/558
* Clear in memory cache every after api calls in unit tests by c-bata in https://github.com/optuna/optuna-dashboard/pull/560
* Update JSON APIs to report preferences and get preferential best trials. by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/559
* Uninstall types/react-router-dom by c-bata in https://github.com/optuna/optuna-dashboard/pull/561
* add is_preferential flag to StudySummary by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/563
* add ignorefile for eslint by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/566
* uniform internal error style by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/567
* Only show legend with multiple studies in the history plot by keisuke-umezawa in https://github.com/optuna/optuna-dashboard/pull/568
* Add initial support for Preferential Optimization by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/565
* Fix the bug while displaying `study_user_attrs` by c-bata in https://github.com/optuna/optuna-dashboard/pull/570
* Merge the implementation of GraphEdf and GraphEdfMultiStudies by keisuke-umezawa in https://github.com/optuna/optuna-dashboard/pull/478
* Store artifact meta in `trial_system_attr` by Alnusjaponica in https://github.com/optuna/optuna-dashboard/pull/564
* Fix the bug while renaming a study with maximize direction by lucasmrdt in https://github.com/optuna/optuna-dashboard/pull/571
* Add docstrings of preferential optimization functions by c-bata in https://github.com/optuna/optuna-dashboard/pull/555
* Add some improvements on SQLite3 WASM loader by c-bata in https://github.com/optuna/optuna-dashboard/pull/574
* Support external_param_value and union_user_attrs on optuna-dashboard-wasm. by c-bata in https://github.com/optuna/optuna-dashboard/pull/575
* Update README and docs for the VS Code extension by c-bata in https://github.com/optuna/optuna-dashboard/pull/579
* Fix the sort of `user_attr` values by c-bata in https://github.com/optuna/optuna-dashboard/pull/580
* Improve human feedback UI for Preferential Optimization by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/572
* Fix lint errors on PR 551 by c-bata in https://github.com/optuna/optuna-dashboard/pull/583
* PreferentialGPSampler by contramundum53 in https://github.com/optuna/optuna-dashboard/pull/551
* Fix an example of preferential optimization by c-bata in https://github.com/optuna/optuna-dashboard/pull/585
* Introduce `skip` flag for preferential optimization by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/581
* Deploy browser-only app to GitHub Pages by c-bata in https://github.com/optuna/optuna-dashboard/pull/582
* Change public path for GitHub pages by c-bata in https://github.com/optuna/optuna-dashboard/pull/588
* Update README and add ogp for optuna-dashboard-wasm by c-bata in https://github.com/optuna/optuna-dashboard/pull/589
* Add GIF animation on README by c-bata in https://github.com/optuna/optuna-dashboard/pull/592
* Add analytics page for preferential by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/587
* Update `.gitignore` for preferential optimization examples by c-bata in https://github.com/optuna/optuna-dashboard/pull/593
* Introduce codecov settings by keisuke-umezawa in https://github.com/optuna/optuna-dashboard/pull/562
* Use a different test fixture for each test file in the e2e tests by keisuke-umezawa in https://github.com/optuna/optuna-dashboard/pull/569
* [preferential] Add `PreferentialStudy.should_generate` by contramundum53 in https://github.com/optuna/optuna-dashboard/pull/595
* [preferential] Add `enqueue_trial` to PreferentialStudy by contramundum53 in https://github.com/optuna/optuna-dashboard/pull/598
* add preference history by moririn2528 in https://github.com/optuna/optuna-dashboard/pull/584
* Support user-defined plotly figures by c-bata in https://github.com/optuna/optuna-dashboard/pull/600
* Bump the version up to `v0.13.0b1` by c-bata in https://github.com/optuna/optuna-dashboard/pull/597

New Contributors
* moririn2528 made their first contribution in https://github.com/optuna/optuna-dashboard/pull/559
* lucasmrdt made their first contribution in https://github.com/optuna/optuna-dashboard/pull/571

**Full Changelog**: https://github.com/optuna/optuna-dashboard/compare/v0.12.0...v0.13.0b1

This is the release note of v0.12.0. See [here](https://github.com/pfnet/optuna/milestone/8?closed=1) for the complete list of solved issues and merged PRs.

New Features
------------
- Implement PercentilePruner. (397, thanks c-bata!)

Bug Fixes
---------
- Fix the error that occurs when using a study that contains old trials. (415)
- Synchronize when _ChainerMNTrial sets values. (413)
- Fix a bug that `FixedTrial` cannot handle categorical parameters correctly. (402)

Compatibility
-------------
- Make the step argument of should_prune method optional. (398, thanks c-bata!)

Documents
---------
- Fix typo of LightGBM. (409, thanks nmasahiro!)
- Use `optuna.load_study()` function instead of `optuna.Study()` constructor. (407)

Examples
--------
- Fix FutureWarnings of scikit-learn. (418, thanks c-bata!)

Others
-----
- Update flake8 exclude option in setup.cfg. (405, thanks c-bata!)

This is the release note of v0.11.0. See [here](https://github.com/pfnet/optuna/milestone/7?closed=1) for the complete list of solved issues and merged PRs.

New Features
------------
- Add pruning callback for MXNet. (363, thanks Rishav1!)

Enhancements
------------
- Support suggestion ranges whose endpoints take the same value. (384)
- Add `distributions` property to trial classes. (383)

Bug Fixes
---------
- Fix installation failure with Python-3.5.2. (396)
- Escape '%' character in storage URL. (395)
- Fix type of suggest APIs. (393)

Examples
--------
- Add PyTorch example. (366, thanks Rishav1!)