Flaml

News
* AAAI-23 tutorial: We will be giving a tutorial about FLAML in AAAI-23 on Feb 08, 2023. Please find the tutorial agenda in this [page](https://github.com/microsoft/FLAML/tree/tutorial-aaai23/tutorial).
* Latest research to appear at ICLR-23: Our latest research on multiobjective HPO is accepted as one of the **notable-top-5% research papers in ICLR 2023**:
- Please find more details about the method in our paper: [Targeted Hyperparameter Optimization with Lexicographic Preferences Over Multiple Objectives](https://openreview.net/forum?id=0Ij9_q567Ma). Shaokun Zhang, Feiran Jia, Chi Wang, Qingyun Wu. ICLR 2023 (notable-top-5%).
- Please find detailed documentation about this new functionality in this page: https://microsoft.github.io/FLAML/docs/Use-Cases/Tune-User-Defined-Function#lexicographic-objectives.
* OpenAI support is added in this release. A notebook example can be found at: https://github.com/microsoft/FLAML/blob/main/notebook/integrate_openai.ipynb

What's Changed
* handle num_samples=-1 by sonichi in https://github.com/microsoft/FLAML/pull/879
* Bump json5 from 2.2.1 to 2.2.3 in /website by dependabot in https://github.com/microsoft/FLAML/pull/877
* fix the doc error of customized metrics in automl by skzhang1 in https://github.com/microsoft/FLAML/pull/883
* Bump ua-parser-js from 0.7.32 to 0.7.33 in /website by dependabot in https://github.com/microsoft/FLAML/pull/900
* display data head in notebook; exclude None by sonichi in https://github.com/microsoft/FLAML/pull/885
* Support percentage tolerance for lexicographic optimization by skzhang1 in https://github.com/microsoft/FLAML/pull/875
* Document how to use the group k-fold by coffepowered in https://github.com/microsoft/FLAML/pull/894
* update doc for research papers by qingyun-wu in https://github.com/microsoft/FLAML/pull/912
* stratified group kfold splitter by sonichi in https://github.com/microsoft/FLAML/pull/899
* add cost budget; move loc of make_dir by sonichi in https://github.com/microsoft/FLAML/pull/888
* Add bibtex entries for research publications by Animaholic in https://github.com/microsoft/FLAML/pull/904
* Openai by sonichi in https://github.com/microsoft/FLAML/pull/905

New Contributors
* coffepowered made their first contribution in https://github.com/microsoft/FLAML/pull/894
* Animaholic made their first contribution in https://github.com/microsoft/FLAML/pull/904

**Full Changelog**: https://github.com/microsoft/FLAML/compare/v1.1.1...v1.1.2

What's Changed
* create dir for log file name by sonichi in https://github.com/microsoft/FLAML/pull/867
* Do not persist entire AutoMLState in Searcher by Yard1 in https://github.com/microsoft/FLAML/pull/870
* fix 871: call check_spark only when necessary by thinkall in https://github.com/microsoft/FLAML/pull/872
* notebook test; spark warning message; reproducibility bug; sequential tuning stop condition by sonichi in https://github.com/microsoft/FLAML/pull/869


**Full Changelog**: https://github.com/microsoft/FLAML/compare/v1.1.0...v1.1.1

Highlights

* Spark is now supported as a new parallel tuning backend.
* New tuning capability: targeted tuning with multiple lexicographic objectives. Check out [documentation](https://microsoft.github.io/FLAML/docs/Use-Cases/Tune-User-Defined-Function#lexicographic-objectives) and an [example](https://microsoft.github.io/FLAML/docs/Examples/Tune-Lexicographic-objectives) for this new tuning capability.
* New metrics: roc_auc_weighted, roc_auc_ovr_weighted, roc_auc_ovo_weighted.
* New reproducible learner selection method when time_budget is not specified.
* AutoML-related functionaility is moved into a new `automl` subpackage.

Thanks to all contributors who contributed to this release!

What's Changed
* Bump actions/checkout from 2 to 3 by dependabot in https://github.com/microsoft/FLAML/pull/699
* fix dependably alert by skzhang1 in https://github.com/microsoft/FLAML/pull/818
* fix typo by skzhang1 in https://github.com/microsoft/FLAML/pull/823
* install editable package in codespace by sonichi in https://github.com/microsoft/FLAML/pull/826
* skip test_hf_data in py 3.6 by sonichi in https://github.com/microsoft/FLAML/pull/832
* fix typo of output directory by thinkall in https://github.com/microsoft/FLAML/pull/828
* catch TFT logger bugs by int-chaos in https://github.com/microsoft/FLAML/pull/833
* roc_auc_weighted metric addition by shreyas36 in https://github.com/microsoft/FLAML/pull/827
* make performance test reproducible by sonichi in https://github.com/microsoft/FLAML/pull/837
* Refactor into automl subpackage by markharley in https://github.com/microsoft/FLAML/pull/809
* Edit the announcement of AAAI-23 tutorial and the KDD tutorial announcement. by HangHouCheong in https://github.com/microsoft/FLAML/pull/820
* Use get to avoid KeyError by sonichi in https://github.com/microsoft/FLAML/pull/824
* Update doc by skzhang1 in https://github.com/microsoft/FLAML/pull/843
* fix bug related to _choice_ by sonichi in https://github.com/microsoft/FLAML/pull/848
* FAQ about OOM by sonichi in https://github.com/microsoft/FLAML/pull/849
* Update .NET documentation links by luisquintanilla in https://github.com/microsoft/FLAML/pull/847
* Added an info reminding user that if no time_budget and no max_iter is specified, then effectively zero-shot AutoML is used by jingdong00 in https://github.com/microsoft/FLAML/pull/850
* Fix example tune-pytorch where the checkpoint path may be named differently by jingdong00 in https://github.com/microsoft/FLAML/pull/853
* Format errors on the web. by skzhang1 in https://github.com/microsoft/FLAML/pull/855
* Add supporting using Spark as the backend of parallel training by thinkall in https://github.com/microsoft/FLAML/pull/846
* Info and naming by sonichi in https://github.com/microsoft/FLAML/pull/864

New Contributors
* thinkall made their first contribution in https://github.com/microsoft/FLAML/pull/828
* markharley made their first contribution in https://github.com/microsoft/FLAML/pull/809
* HangHouCheong made their first contribution in https://github.com/microsoft/FLAML/pull/820

**Full Changelog**: https://github.com/microsoft/FLAML/compare/v1.0.14...v1.1.0

Highlights
* Preparing alpha release of multi-objective hyperparameter tuning with lexicographic preference.
* Fixed issues related to zero-shot automl.
* Multiple improvements to documentation.

What's Changed
* Discord Badge Added by royninja in https://github.com/microsoft/FLAML/pull/760
* fix bug in current nlp documentation by liususan091219 in https://github.com/microsoft/FLAML/pull/763
* Multiple objectives hyperparameter tuning with lexicographic preference by Anonymous-submission-repo in https://github.com/microsoft/FLAML/pull/752
* Indentation corrected by Kirito-Excalibur in https://github.com/microsoft/FLAML/pull/778
* Included hint to escape brackets for pip setup by evensure in https://github.com/microsoft/FLAML/pull/786
* Docs by velezbeltran in https://github.com/microsoft/FLAML/pull/765
* Bump actions/setup-python from 2 to 4 by dependabot in https://github.com/microsoft/FLAML/pull/700
* Bump codecov/codecov-action from 1 to 3 by dependabot in https://github.com/microsoft/FLAML/pull/697
* Removed extra | in documentation by satya-vinay in https://github.com/microsoft/FLAML/pull/790
* fix_alert by skzhang1 in https://github.com/microsoft/FLAML/pull/793
* Fixed typo by ElinaAndreeva in https://github.com/microsoft/FLAML/pull/797
* fix_alerts by skzhang1 in https://github.com/microsoft/FLAML/pull/799
* Documentation about classification/regression task 753 by royninja in https://github.com/microsoft/FLAML/pull/802
* Added a link to documentation webpage in notebook time_series_forcast by jingdong00 in https://github.com/microsoft/FLAML/pull/791
* Fix issues related to zero-shot automl by sonichi in https://github.com/microsoft/FLAML/pull/783
* added the models used for forecasting in documentation by shreyas36 in https://github.com/microsoft/FLAML/pull/811
* Add performance test for LexiFlow by Anonymous-submission-repo in https://github.com/microsoft/FLAML/pull/812

New Contributors
* royninja made their first contribution in https://github.com/microsoft/FLAML/pull/760
* Anonymous-submission-repo made their first contribution in https://github.com/microsoft/FLAML/pull/752
* Kirito-Excalibur made their first contribution in https://github.com/microsoft/FLAML/pull/778
* evensure made their first contribution in https://github.com/microsoft/FLAML/pull/786
* velezbeltran made their first contribution in https://github.com/microsoft/FLAML/pull/765
* satya-vinay made their first contribution in https://github.com/microsoft/FLAML/pull/790
* ElinaAndreeva made their first contribution in https://github.com/microsoft/FLAML/pull/797
* jingdong00 made their first contribution in https://github.com/microsoft/FLAML/pull/791
* shreyas36 made their first contribution in https://github.com/microsoft/FLAML/pull/811

**Full Changelog**: https://github.com/microsoft/FLAML/compare/v1.0.13...v1.0.14

Highlights
* Logging the search_state.config directly to MLflow instead of key-dictionary pair
* Move searcher and scheduler into tune
* Move import location for Ray 2
* Fix NLP dimension mismatch bug

What's Changed
* Dockerfile building problem by skzhang1 in https://github.com/microsoft/FLAML/pull/719
* Update Contribute.md by vijaya-lakshmi-venkatraman in https://github.com/microsoft/FLAML/pull/716
* Move import location for Ray 2 by sonichi in https://github.com/microsoft/FLAML/pull/721
* Fix issue 728 add hyperlink to GitHub location by Libens-bufo in https://github.com/microsoft/FLAML/pull/731
* Update model.py by vijaya-lakshmi-venkatraman in https://github.com/microsoft/FLAML/pull/739
* Issue724 by liususan091219 in https://github.com/microsoft/FLAML/pull/745
* log search_state.config directly instead of under tag config by prithvikannan in https://github.com/microsoft/FLAML/pull/747
* move searcher and scheduler into tune by sonichi in https://github.com/microsoft/FLAML/pull/746
* updating the data collator for seq-regression to handle the dim mismatch problem by liususan091219 in https://github.com/microsoft/FLAML/pull/751
* Update Contribute by sonichi in https://github.com/microsoft/FLAML/pull/741
* Remove NLP classification head by liususan091219 in https://github.com/microsoft/FLAML/pull/756

New Contributors
* vijaya-lakshmi-venkatraman made their first contribution in https://github.com/microsoft/FLAML/pull/716
* Libens-bufo made their first contribution in https://github.com/microsoft/FLAML/pull/731
* prithvikannan made their first contribution in https://github.com/microsoft/FLAML/pull/747

**Full Changelog**: https://github.com/microsoft/FLAML/compare/v1.0.12...v1.0.13

Highlights
* Fix MLFlow bug to support the case where search.state.metric_for_logging is None
* Support customized cross-validation strategy
* Fix SARIMAX seasonal_order parameter name in the wrapper

Thanks to all the contributors for this release!

What's Changed
* chore: Auto update github actions with dependabot by iemejia in https://github.com/microsoft/FLAML/pull/688
* talks and tutorials by qingyun-wu in https://github.com/microsoft/FLAML/pull/694
* updating nlp notebook by liususan091219 in https://github.com/microsoft/FLAML/pull/693
* "intermediate_results" TypeError: argument of type 'NoneType' is not iterable by liususan091219 in https://github.com/microsoft/FLAML/pull/695
* Update Research.md by sonichi in https://github.com/microsoft/FLAML/pull/701
* Bump actions/setup-node from 2 to 3 by dependabot in https://github.com/microsoft/FLAML/pull/698
* Bump actions/cache from 1 to 3 by dependabot in https://github.com/microsoft/FLAML/pull/696
* Support customized cross-validation strategy by skzhang1 in https://github.com/microsoft/FLAML/pull/669
* Add `$schema` to `cgmanifest.json` by JamieMagee in https://github.com/microsoft/FLAML/pull/708
* Fix SARIMAX seasonal_order parameter name in the wrapper by EgorKraevTransferwise in https://github.com/microsoft/FLAML/pull/711

New Contributors
* iemejia made their first contribution in https://github.com/microsoft/FLAML/pull/688
* JamieMagee made their first contribution in https://github.com/microsoft/FLAML/pull/708
* EgorKraevTransferwise made their first contribution in https://github.com/microsoft/FLAML/pull/711

**Full Changelog**: https://github.com/microsoft/FLAML/compare/v1.0.11...v1.0.12