Oumi

What's Changed
* Increment `pillow` version for compatibility with Python 3.13 by nikg4 in https://github.com/oumi-ai/oumi/pull/1566
* [Evaluation] Bug: Multiple GPUs attempt to save in the same folder by kaisopos in https://github.com/oumi-ai/oumi/pull/1567


**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.9...v0.1.10

What's Changed
* Add QwQ full fine-tune and QLoRA configs by wizeng23 in https://github.com/oumi-ai/oumi/pull/1518
* Update TRL to 0.15 and fix Liger/dataset code by wizeng23 in https://github.com/oumi-ai/oumi/pull/1507
* [tiny] Remove vLLM Colab link and fix Alpaca Eval quickstart by wizeng23 in https://github.com/oumi-ai/oumi/pull/1530
* Evaluation: Inference optimizations by kaisopos in https://github.com/oumi-ai/oumi/pull/1522
* Qwen2.5 VL: Replace "from source" install with `transformers>=0.49` by nikg4 in https://github.com/oumi-ai/oumi/pull/1528
* [Evaluation] Renaming `evaluation_platform` → `evaluation_backend` by kaisopos in https://github.com/oumi-ai/oumi/pull/1526
* [tiny] Clean up datasets code by wizeng23 in https://github.com/oumi-ai/oumi/pull/1529
* Minor logging improvements in `BaseMapDataset` by nikg4 in https://github.com/oumi-ai/oumi/pull/1532
* Upload scripts used in a Weekly Walkthrough by taenin in https://github.com/oumi-ai/oumi/pull/1533
* Update VisionLanguageConversationFeatureGenerator by nikg4 in https://github.com/oumi-ai/oumi/pull/1531
* [docs] add security.md by oelachqar in https://github.com/oumi-ai/oumi/pull/1534
* [Evaluation] Custom evaluation notebook: a reliability classifier by kaisopos in https://github.com/oumi-ai/oumi/pull/1535
* Multimodal: Limit max number of images per Conversation by nikg4 in https://github.com/oumi-ai/oumi/pull/1536
* Auto-populate and validate params specific to `vision_language_sft` collator in `TrainingConfig` by nikg4 in https://github.com/oumi-ai/oumi/pull/1537
* Update Oumi Env to use Rich formatting by taenin in https://github.com/oumi-ai/oumi/pull/1541
* Update oumi launch to use Rich formatting by taenin in https://github.com/oumi-ai/oumi/pull/1543
* Update oumi evaluate to use rich formatting. by taenin in https://github.com/oumi-ai/oumi/pull/1544
* Update the CLI to replace all prints with Rich prints. by taenin in https://github.com/oumi-ai/oumi/pull/1547
* Render the oumi env command as a shell block in bug reports. by taenin in https://github.com/oumi-ai/oumi/pull/1548
* Define `Conversation` proto bufs by nikg4 in https://github.com/oumi-ai/oumi/pull/1550
* [Evaluation] Modifying Alpaca Eval results format to be consistent with LM Harness by kaisopos in https://github.com/oumi-ai/oumi/pull/1551
* Augmenting logging training/model statistics by optas in https://github.com/oumi-ai/oumi/pull/1545
* Misc no-op code cleanups by nikg4 in https://github.com/oumi-ai/oumi/pull/1553
* Add code used for the evaluation demo. by taenin in https://github.com/oumi-ai/oumi/pull/1556
* Add `OUMI_FORCE_EDITABLE_INSTALL` env var to do editable Oumi install from source in job configs by wizeng23 in https://github.com/oumi-ai/oumi/pull/1420
* Add letter counting GRPO example by wizeng23 in https://github.com/oumi-ai/oumi/pull/1539
* Remove UV install from notebooks as this breaks colab by taenin in https://github.com/oumi-ai/oumi/pull/1558
* [Evaluation] Updates in hallucination notebook by kaisopos in https://github.com/oumi-ai/oumi/pull/1552
* [Evaluations] Custom evals: Adding support for `eval_kwargs` by kaisopos in https://github.com/oumi-ai/oumi/pull/1557
* Logging message update in `log_number_of_model_parameters` by nikg4 in https://github.com/oumi-ai/oumi/pull/1560
* [Evaluation][Custom] Removing restrictions and better error checking by kaisopos in https://github.com/oumi-ai/oumi/pull/1561
* Support text truncation (`max_length`) for `vision_language_sft` collator by nikg4 in https://github.com/oumi-ai/oumi/pull/1559
* phi 4 multimodal training version 1 ( with limitations ) by optas in https://github.com/oumi-ai/oumi/pull/1555
* Phi-4 basic inference with native/vllm by optas in https://github.com/oumi-ai/oumi/pull/1563
* [minor] phi4 train improvements by optas in https://github.com/oumi-ai/oumi/pull/1564
* Fix printing errors in oumi env for non-string values. by taenin in https://github.com/oumi-ai/oumi/pull/1565


**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.8...v0.1.9

What's Changed
* GRPO trainer: Minimal initial integration by nikg4 in https://github.com/oumi-ai/oumi/pull/1482
* Update oumi infer to fall back to interactive mode if no input path is specified. by taenin in https://github.com/oumi-ai/oumi/pull/1483
* Add sample DDP/GCP config for GRPO trainer by nikg4 in https://github.com/oumi-ai/oumi/pull/1485
* Temporary fix for chat template issue with multimodal inference w/ in-process vLLM engine by nikg4 in https://github.com/oumi-ai/oumi/pull/1486
* [tiny] Update async_eval.yaml comments to reference correct class by wizeng23 in https://github.com/oumi-ai/oumi/pull/1488
* Fix a bug where overriding remote_params fails via the CLI (oumi infer) by taenin in https://github.com/oumi-ai/oumi/pull/1487
* Define `GrpoParams` under configs by nikg4 in https://github.com/oumi-ai/oumi/pull/1490
* Support more GRPO params by nikg4 in https://github.com/oumi-ai/oumi/pull/1491
* Minor updates to `oumi env` by nikg4 in https://github.com/oumi-ai/oumi/pull/1492
* Warn instead of error when device not found for MFU calculation by wizeng23 in https://github.com/oumi-ai/oumi/pull/1489
* Updated all CLI endpoints to support oumi:// prefix by Spaarsh in https://github.com/oumi-ai/oumi/pull/1468
* Fix chat template issue for nested content parts used for VLMs by nikg4 in https://github.com/oumi-ai/oumi/pull/1493
* Ctseng777/judge by ctseng777 in https://github.com/oumi-ai/oumi/pull/1474
* [Evaluation] Modularization & enabling custom evaluations by kaisopos in https://github.com/oumi-ai/oumi/pull/1484
* Update documentation formatting for BaseModel by taenin in https://github.com/oumi-ai/oumi/pull/1494
* Fix `log_samples` not propagating from `eval_kwargs` by jgreer013 in https://github.com/oumi-ai/oumi/pull/1496
* [Evaluation] Adding support for logging model samples for all backends by kaisopos in https://github.com/oumi-ai/oumi/pull/1499
* Support for deprecated input param (` evaluation_platform`) by kaisopos in https://github.com/oumi-ai/oumi/pull/1500
* Limiting the AlpacaEval number of samples for quickstart by kaisopos in https://github.com/oumi-ai/oumi/pull/1501
* Add recurring tests to keep our test badges updated. by taenin in https://github.com/oumi-ai/oumi/pull/1498
* Add a schedule for our GPU, CPU, and doc tests by taenin in https://github.com/oumi-ai/oumi/pull/1503
* Update the GPU Tests badge to use results from main by taenin in https://github.com/oumi-ai/oumi/pull/1504
* vLLM version increment by nikg4 in https://github.com/oumi-ai/oumi/pull/1502
* Minor logging improvements by nikg4 in https://github.com/oumi-ai/oumi/pull/1505
* [Evaluation] Save Utils: Moving, fixes, and unit tests by kaisopos in https://github.com/oumi-ai/oumi/pull/1506
* Update sample GRPO script to validate num_generations by nikg4 in https://github.com/oumi-ai/oumi/pull/1509
* Resolve warning about `--dispatch batches` deprecated param by nikg4 in https://github.com/oumi-ai/oumi/pull/1510
* [Evaluation] Re-enabling evaluations with Math Hard (`leaderboard_math_hard`) by kaisopos in https://github.com/oumi-ai/oumi/pull/1511
* Update docker image and build script by oelachqar in https://github.com/oumi-ai/oumi/pull/1508
* Add Qwen QwQ Lora config by wizeng23 in https://github.com/oumi-ai/oumi/pull/1514
* Add QwQ eval/infer configs by wizeng23 in https://github.com/oumi-ai/oumi/pull/1515
* [Evaluation] Instantiating an inference engine (if needed) when running custom evaluations by kaisopos in https://github.com/oumi-ai/oumi/pull/1513
* Switch eval yaml configs to use evaluation_platform by wizeng23 in https://github.com/oumi-ai/oumi/pull/1516
* Mark `BaseMapDataset` as `typing.Sized` by nikg4 in https://github.com/oumi-ai/oumi/pull/1517
* VLM collator refactor by nikg4 in https://github.com/oumi-ai/oumi/pull/1512


**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.7...v0.1.8

What's Changed
* Update the RemoteInferenceEngine to appropriately handle openai format batch prediction endpoints. by taenin in https://github.com/oumi-ai/oumi/pull/1472
* Fix local models to not break the registry. by taenin in https://github.com/oumi-ai/oumi/pull/1476
* Create an inference config for Claude Sonnet 3.7 by taenin in https://github.com/oumi-ai/oumi/pull/1479
* Add notebook for fine-tuning MiniMath-R1-1.5B by jgreer013 in https://github.com/oumi-ai/oumi/pull/1480
* [Evaluation] Migrate LM Harness integration point from `simple_evaluate` to `evaluate` by kaisopos in https://github.com/oumi-ai/oumi/pull/1455
* [tiny]Update trl to 0.14 by wizeng23 in https://github.com/oumi-ai/oumi/pull/1478


**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.6...v0.1.7

What's Changed
* Update RemoteParams to no longer require an API URL. by taenin in https://github.com/oumi-ai/oumi/pull/1452
* [Tiny] Update default training params for Qwen2-VL-2B-Instruct by optas in https://github.com/oumi-ai/oumi/pull/1454
* [Tiny] Add more warnings for "special" requirements of Qwen2.5-VL by optas in https://github.com/oumi-ai/oumi/pull/1453
* Minor cleanup of oumi fetch by taenin in https://github.com/oumi-ai/oumi/pull/1463
* Support for multi-image VLM training by nikg4 in https://github.com/oumi-ai/oumi/pull/1448
* Remove a temp workaround in `pad_sequences` on the left side by nikg4 in https://github.com/oumi-ai/oumi/pull/1464
* [tiny] Add warning that Oumi doesn't support Intel Macs by wizeng23 in https://github.com/oumi-ai/oumi/pull/1467
* VLM-related logging improvements by nikg4 in https://github.com/oumi-ai/oumi/pull/1469
* Fix Oumi launcher to be able to run on RunPod and Lambda by wizeng23 in https://github.com/oumi-ai/oumi/pull/1470
* Enable pre-release install for uv in pyproject.toml by wizeng23 in https://github.com/oumi-ai/oumi/pull/1466


**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.5...v0.1.6

What's Changed
* Fix the remainder of our configs by wizeng23 in https://github.com/oumi-ai/oumi/pull/1356
* Adopt new Llama 3.1 HF names by wizeng23 in https://github.com/oumi-ai/oumi/pull/1357
* Define `OUMI_USE_SPOT_VM` env var and start using it to override `use_spot` param by xrdaukar in https://github.com/oumi-ai/oumi/pull/1359
* Support HuggingFaceM4/Docmatix dataset by vishwamartur in https://github.com/oumi-ai/oumi/pull/1342
* [nit] update default issue names by oelachqar in https://github.com/oumi-ai/oumi/pull/1367
* Update sft_datasets.md by penfever in https://github.com/oumi-ai/oumi/pull/1349
* Have GitHub Trending image hyperlink to GitHub Trending page by wizeng23 in https://github.com/oumi-ai/oumi/pull/1370
* Update the link for the trending banner. by taenin in https://github.com/oumi-ai/oumi/pull/1371
* Move code to disable caching in `model.config` to a helper function by xrdaukar in https://github.com/oumi-ai/oumi/pull/1378
* Update transformers version to 4.48 by wizeng23 in https://github.com/oumi-ai/oumi/pull/1372
* Update notebooks to improve their Colab experience by wizeng23 in https://github.com/oumi-ai/oumi/pull/1380
* Add proper labels and types to new Bugs and Feature Requests. by taenin in https://github.com/oumi-ai/oumi/pull/1383
* Upgrade omegaconf to 2.4.0dev3 by wizeng23 in https://github.com/oumi-ai/oumi/pull/1384
* Support HuggingFaceM4/the_cauldron dataset by vishwamartur in https://github.com/oumi-ai/oumi/pull/1366
* Update our FAQ for tips about installing oumi on Windows by taenin in https://github.com/oumi-ai/oumi/pull/1385
* Cleanup `HuggingFaceM4/Docmatix` and `HuggingFaceM4/the_cauldron` multimodal datasets by xrdaukar in https://github.com/oumi-ai/oumi/pull/1387
* Remove uneeded env vars from job configs by wizeng23 in https://github.com/oumi-ai/oumi/pull/1390
* Remove transformer version override for `HuggingFaceTB/SmolVLM-Instruct` in launcher script by xrdaukar in https://github.com/oumi-ai/oumi/pull/1388
* [Small Refactor] Moving the inference engine def outside the inference config by kaisopos in https://github.com/oumi-ai/oumi/pull/1395
* Evaluation - LM Harness: Adding vLLM support by kaisopos in https://github.com/oumi-ai/oumi/pull/1379
* Remove `Docmatix` dataset references from docstrings VLM config examples by xrdaukar in https://github.com/oumi-ai/oumi/pull/1397
* Fixed broken link in Oumi - A Tour.ipynb notebook by ciaralema in https://github.com/oumi-ai/oumi/pull/1398
* Fix broken links in notebooks. by taenin in https://github.com/oumi-ai/oumi/pull/1402
* Create a client for communicating with a Slurm node via SSH. by taenin in https://github.com/oumi-ai/oumi/pull/1389
* [tiny] Remove references to missing job configs in README by wizeng23 in https://github.com/oumi-ai/oumi/pull/1404
* Train+Inference with Qwen 2.5 VL (3B) by optas in https://github.com/oumi-ai/oumi/pull/1396
* Add a Slurm cluster and cloud to the oumi launcher. by taenin in https://github.com/oumi-ai/oumi/pull/1406
* Move `pretokenize` script from `scripts/pretokenize/` to `scripts/datasets/pretokenize/` by xrdaukar in https://github.com/oumi-ai/oumi/pull/1412
* Create a script to save `Conversation`-s from SFT datasets into `.jsonl` file by xrdaukar in https://github.com/oumi-ai/oumi/pull/1413
* [Evaluation] LM Harness refactor by kaisopos in https://github.com/oumi-ai/oumi/pull/1410
* Update `save_conversations` tool by xrdaukar in https://github.com/oumi-ai/oumi/pull/1421
* [SambaNova] Integrate SambaNova Systems to oumi inference by ctseng777 in https://github.com/oumi-ai/oumi/pull/1415
* [Μinor] Equating Qwen's 2.5 chat-template to version's 2.0 by optas in https://github.com/oumi-ai/oumi/pull/1419
* Add requirements header to configs and clean them up by wizeng23 in https://github.com/oumi-ai/oumi/pull/1411
* Updated oumi infer to support CLI argument for system prompt by Spaarsh in https://github.com/oumi-ai/oumi/pull/1422
* [Evaluation] LM Harness remote server support by kaisopos in https://github.com/oumi-ai/oumi/pull/1414
* [Feature] Add Tulu3 SFT Mixture Dataset Support by bwalshe in https://github.com/oumi-ai/oumi/pull/1381
* Support Multimodal inference with multiple images and PDF-s in `NATIVE` engine by xrdaukar in https://github.com/oumi-ai/oumi/pull/1424
* Update notebooks to run on Colab by wizeng23 in https://github.com/oumi-ai/oumi/pull/1423
* Add calm recipe. by taenin in https://github.com/oumi-ai/oumi/pull/1425
* Update VLM sample `oumi infer -i` commands by xrdaukar in https://github.com/oumi-ai/oumi/pull/1428
* Provide example show to start SGLang server using Docker by xrdaukar in https://github.com/oumi-ai/oumi/pull/1429
* Multi-image support in SGLang inference engine by xrdaukar in https://github.com/oumi-ai/oumi/pull/1426
* Calm readme by emrecanacikgoz in https://github.com/oumi-ai/oumi/pull/1432
* WildChat-50M Reproduction by penfever in https://github.com/oumi-ai/oumi/pull/1433
* Add WildChat support by penfever in https://github.com/oumi-ai/oumi/pull/1348
* Create `pad_to_max_dim_and_stack()` function in torch_utils by xrdaukar in https://github.com/oumi-ai/oumi/pull/1435
* use deterministic by penfever in https://github.com/oumi-ai/oumi/pull/1434
* Additional HF trainer parameters for config by penfever in https://github.com/oumi-ai/oumi/pull/1436
* Set a better default for vllm inference GPU usage. by taenin in https://github.com/oumi-ai/oumi/pull/1437
* Added fetch command and modified infer command to resolve oumi:// by Spaarsh in https://github.com/oumi-ai/oumi/pull/1439
* Require an inference config for oumi infer. by taenin in https://github.com/oumi-ai/oumi/pull/1443
* Make the tulu3 unit tests hermetic. by taenin in https://github.com/oumi-ai/oumi/pull/1446
* Add 2 more sample PDF-s with 1 and 2 pages under `testdata/pdfs` by xrdaukar in https://github.com/oumi-ai/oumi/pull/1427
* Enable ability to override list values in config via CLI by wizeng23 in https://github.com/oumi-ai/oumi/pull/1430
* Renamed CALM to CoALM by jgreer013 in https://github.com/oumi-ai/oumi/pull/1450
* Add support for Docmatix dataset to multimodal training script by xrdaukar in https://github.com/oumi-ai/oumi/pull/1449
* Update oumi launch status to show clusters with no running jobs. by taenin in https://github.com/oumi-ai/oumi/pull/1451

New Contributors
* vishwamartur made their first contribution in https://github.com/oumi-ai/oumi/pull/1342
* ctseng777 made their first contribution in https://github.com/oumi-ai/oumi/pull/1415
* Spaarsh made their first contribution in https://github.com/oumi-ai/oumi/pull/1422
* bwalshe made their first contribution in https://github.com/oumi-ai/oumi/pull/1381
* emrecanacikgoz made their first contribution in https://github.com/oumi-ai/oumi/pull/1432

**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.4...v0.1.5