Ms-swift

English Version

New Features:
1. Inference and deployment support for logprobs.
2. RLHF support for lazy_tokenize.
3. Multimodal model support for neftune.
4. dynamic_eos compatibility with glm4 series and other models.

New Models:
1. mplug-owl3, best practices can be found [here](https://github.com/modelscope/ms-swift/issues/1969).
2. yi-coder 1.5b, base/chat model of 9b.
3. minicpm3-4b.
4. reflection-llama3.1-70b.

中文版

新功能：
1. 推理和部署支持 logprobs。
2. RLHF支持lazy_tokenize。
3. 多模态模型支持neftune。
4. dynamic_eos兼容glm4系列等模型。

新模型：
1. mplug-owl3，最佳实践可以查看[这里](https://github.com/modelscope/ms-swift/issues/1969)。
2. yi-coder 1.5b、9b 的base/chat模型。
3. minicpm3-4b。
4. reflection-llama3.1-70b。

What's Changed
* Fix push_to_hub when last-checkpoint by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1897
* support custom quantized dataset by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1893
* fix push_to_ms by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1901
* support logprobs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1900
* deepspeed use cosine lr_schduler by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1907
* update docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1908
* fix web-ui push to hub strategy by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1909
* Refactor docs by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1912
* refactor docs by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1915
* [TorchAcc] perf: use xm.save instead of torch.save by baoleai in https://github.com/modelscope/ms-swift/pull/1916
* update wechat by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1925
* update docs & fix bug by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1926
* [TorchAcc] fix: fix the judegement of fsdp_num by baoleai in https://github.com/modelscope/ms-swift/pull/1903
* Support deploy & logprobs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1833
* fix typing by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1933
* fix swift deploy by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1936
* update yi-coder by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1942
* fix lmdeploy seed by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1945
* fix do_sample by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1946
* refactor rlhf by hjh0119 in https://github.com/modelscope/ms-swift/pull/1885
* fix file rename error in megatron when there are multi process by Zhikaiiii in https://github.com/modelscope/ms-swift/pull/1948
* fix qwen2-vl & video by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1950
* support dynamic_eos by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1947
* fix rlhf by hjh0119 in https://github.com/modelscope/ms-swift/pull/1949
* Support minicpm 3 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1952
* Add lazy_tokenize to RLHF by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1956
* Fix data info print in rlhf by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1964
* Fix the lora hook by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1963
* fix bugs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1959
* support mplug_owl3 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1957
* update docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1970
* Add reflection model by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1973
* fix typo by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1980


**Full Changelog**: https://github.com/modelscope/ms-swift/compare/v2.4.0...v2.4.1

English Version

New Features:
1. Support for Liger, which accommodates models like LLaMA, Qwen, Mistral, etc., and reduces memory usage by 10% to 60%.
2. Support for custom loss function training using a registration mechanism.
3. Training now supports pushing models to ModelScope and HuggingFace.
4. Support for the `freeze_vit` parameter to control the behavior of full parameter training for multimodal models.

New Models:
1. Qwen2-VL series includes GPTQ/AWQ quantized models. For best practices, see [here](https://github.com/modelscope/ms-swift/blob/main/docs/source_en/Multi-Modal/qwen2-vl-best-practice.md).
2. InternVL2 AWQ quantized models.

New Datasets:
1. qwen2-pro series

中文版

新特性：
1. 支持 Liger训练LLaMA、Qwen、Mistral 等模型，内存使用降低 10% 至 60%。
2. 支持使用注册机制进行自定义损失函数的训练。
3. 训练支持将模型推送至 ModelScope 和 HuggingFace。
4. 支持 freeze_vit 参数，以控制多模态模型全参数训练的行为。

新模型：
1. Qwen2-VL 系列包括 GPTQ/AWQ 量化模型，最佳实践可以查看[这里](https://github.com/modelscope/ms-swift/blob/main/docs/source_en/Multi-Modal/qwen2-vl-best-practice.md)。
2. InternVL2 AWQ 量化模型。

新数据集：
1. qwen2-pro 系列

What's Changed
* compat with vllm==0.5.5 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1812
* Support zero2 offload by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1814
* fix mp+ddp & resume_from_checkpoint by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1815
* fix preprocess_num_proc by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1818
* Support liger by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1819
* fix dora deployment by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1821
* Support register loss func by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1822
* use default-lora by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1823
* fix minicpm-v 2.6 infer device_map by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1832
* Fix code by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1824
* fix inject by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1835
* support qwen2-pro dataset by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1834
* add ddp_timeout parameter by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1836
* fix internlm-xcomposer rlhf by hjh0119 in https://github.com/modelscope/ms-swift/pull/1838
* Support eval_nproc by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1843
* support qwen2-vl by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1842
* Add internvl2 awq models by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1846
* Fix some datasets for streaming by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1848
* Fix Pissa and OLoRA by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1852
* Support qwen2 vl grounding by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1854
* support qwen2-vl & video finetune by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1849
* Update new datasets by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1855
* update qwen2-vl docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1856
* update qwen2-vl docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1858
* fix qwen2-vl docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1861
* fix requirements by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1864
* update docs qwen2-vl by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1869
* Support faster data map by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1871
* [TorchAcc] fix serveral bugs for torchacc FSDP. by baoleai in https://github.com/modelscope/ms-swift/pull/1872
* Add train record by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1873
* Fix num_proc by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1874
* Fix neftune doc by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1875
* add duet by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1877
* use model.generation_config by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1850
* Support freeze vit by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1880
* support qwen2-vl gptq awq by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1884
* Refactor push_to_hub by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1883
* Fix push to hub logic by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1888
* add vllm lmdeploy benchmark by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1889
* Add some warnings and fix RLHF by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1890


**Full Changelog**: https://github.com/modelscope/ms-swift/compare/v2.3.2...v2.4.0

English Version
New Features:
1. ReFT support: achieves parameter efficiency that is 15× to 65× greater than LoRA.
2. Multimodal model supports zero3.
3. Supports using environment variables to control parameters such as hd_num, max_num, and video_segments.

New Models:
1. longwriter-glm4-9b, longwriter-llama3_1-8b
2. phi3_5-mini-instruct, phi3_5-moe-instruct, phi3_5-vision-instruct
3. llava-onevision-qwen2-0_5b-ov, llava-onevision-qwen2-7b-ov, llava-onevision-qwen2-72b-ov

New Datasets:
1. longwriter-6k
2. rlaif-v
3. latex-ocr-print, latex-ocr-handwrite

中文版

新功能：
1. 支持ReFT，实现了比 LoRA 高 15 倍到 65 倍的参数效率。
2. 多模态模型支持 zero3。
3. 支持使用环境变量控制模型特有的参数，如 hd_num、max_num 和 video_segments。

新模型：
1. longwriter-glm4-9b, longwriter-llama3_1-8b
2. phi3_5-mini-instruct, phi3_5-moe-instruct, phi3_5-vision-instruct
3. llava-onevision-qwen2-0_5b-ov, llava-onevision-qwen2-7b-ov, llava-onevision-qwen2-72b-ov

新数据集：
1. longwriter-6k
2. rlaif-v
3. latex-ocr-print, latex-ocr-handwrite

What's Changed
* fix imports by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1748
* compat with torch=1.12/1.13 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1752
* update rlaif-v hf dataset by hjh0119 in https://github.com/modelscope/ms-swift/pull/1755
* fix lmdeploy: AssertionError: failed to match chat template, please explicit set chat_template_config by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1759
* use eager -> sdpa by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1764
* Fix GLM4 agent toolcall by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1767
* Support LongWriter-llama3.1-8b and LongWriter-glm4-9b. by DaozeZhang in https://github.com/modelscope/ms-swift/pull/1762
* Support llava onevision by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1761
* [TorchAcc] fix: fix saving and loading checkpoint for full sft FSDP by baoleai in https://github.com/modelscope/ms-swift/pull/1765
* Fix deepseek-coder-v2-lite template by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1771
* Fix qwen2-audio & zero3 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1774
* Fix zero3 & minicpm-v/internvl2/xcomposer by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1772
* fix infer dataset_test_ratio by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1779
* fix moe & gradient_checkpointing by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1782
* support phi3.5-vision by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1780
* ReFT by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1785
* update doc by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1789
* support qwen-vl & base64 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1790
* fix yi-vl template by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1793
* fix bugs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1794
* fix imports by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1796
* fix history_roles by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1798
* fix mllm rlhf with full sft type by hjh0119 in https://github.com/modelscope/ms-swift/pull/1800
* fix CI by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1797
* fix megatron_patch_path by wning13 in https://github.com/modelscope/ms-swift/pull/1804
* Support hd num by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1801
* Support Latex OCR dataset by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1810
* fix offline export by wning13 in https://github.com/modelscope/ms-swift/pull/1805
* fix by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1811

New Contributors
* wning13 made their first contribution in https://github.com/modelscope/ms-swift/pull/1804

**Full Changelog**: https://github.com/modelscope/ms-swift/compare/v2.3.1...v2.3.2

English Version
New Features:

English Version

New Features
1. Support for readthedocs documentation site at: https://swift.readthedocs.io/en/latest
2. Support Megatron architecture training for QianWen series models, and added new `pt` command for pretraining. See docs: https://swift.readthedocs.io/en/latest/LLM/Megatron-training.html
3. Support LMDeploy for inference and deployment, improving inference acceleration for multi-modal models. See: https://swift.readthedocs.io/en/latest/Multi-Modal/LmDeploy-inference-acceleration.html
4. Support passing lora target modules via regular expressions
5. Support configuring max_memory usage for each GPU in device_map
6. `export` command supports BitsAndBytes quantization
7. `export` command supports Ollama export: https://swift.readthedocs.io/en/latest/LLM/OLLaMA-Export.html
8. Support Q-GaLore algorithm
9. Support RLHF training for multi-modal models: https://swift.readthedocs.io/en/latest/Multi-Modal/human-preference-alignment-training-documentation.html
10. Support evaluation on 100+ datasets for multi-modal models: https://swift.readthedocs.io/en/latest/LLM/LLM-eval.html
11. Support resizing input images when memory usage is too high for multi-modal models
12. Modified default lora injection for multi-modal model training. Now takes effect on LLM and projector, results are better without significantly increasing training memory.
13. Support PEFT 0.12, and added new tuner: fourierft
14. Support rope-scaling for multi-modal models
15. Support streaming processing of datasets to reduce memory usage, enable with `--streaming`
16. Support vLLM multi-modal inference and deployment
17. Support grounding task for popular multi-modal models.

New Models
1. qwen2-audio series
2. qwen2-math
4. codegeex4
5. internvl2 series
6. llava video
7. xcomposer2.5
8. cogvlm2-video
9. numina-math
10. mistral-nemo
11. llama3.1 series
12. mistral-large
13. gemma-2-2b
14. internlm2.5 1.8b 20b
15. minicpm-v-v2_6-chat

Check: https://swift.readthedocs.io/en/latest/LLM/Supported-models-datasets.html

New Datasets
1. zhihu-kol and zhihu-kol-filtered
2. SA1B series multi-modal zh datasets

Check: https://swift.readthedocs.io/en/latest/LLM/Supported-models-datasets.html

中文版本

新功能
1. 支持readthedocs文档库， 地址：https://swift.readthedocs.io/zh-cn/latest
2. 支持千问系列模型的Megatron结构训练，并支持了新的pt命令用于预训练，详见文档：https://swift.readthedocs.io/zh-cn/latest/LLM/Megatron%E8%AE%AD%E7%BB%83%E6%96%87%E6%A1%A3.html
3. 支持LMDeploy的推理和部署，更好地支持了多模态模型的推理加速，详见：https://swift.readthedocs.io/zh-cn/latest/Multi-Modal/LmDeploy%E6%8E%A8%E7%90%86%E5%8A%A0%E9%80%9F%E6%96%87%E6%A1%A3.html
4. 支持以正则表达式方式传入lora target模块
5. 支持配置device_map各GPU用量的max_memory
6. export命令支持BitsAndBytes量化
7. export命令支持Ollama导出：https://swift.readthedocs.io/zh-cn/latest/LLM/OLLAMA%E5%AF%BC%E5%87%BA%E6%96%87%E6%A1%A3.html
8. 支持Q-GaLore算法
9. 支持多模态模型的RLHF训练：https://swift.readthedocs.io/zh-cn/latest/Multi-Modal/%E4%BA%BA%E7%B1%BB%E5%81%8F%E5%A5%BD%E5%AF%B9%E9%BD%90%E8%AE%AD%E7%BB%83%E6%96%87%E6%A1%A3.html
10. 支持多模态模型100+数据集的评测能力：https://swift.readthedocs.io/zh-cn/latest/LLM/LLM%E8%AF%84%E6%B5%8B%E6%96%87%E6%A1%A3.html
11. 支持多模态模型显存占用过高时对输入图片进行缩放
12. 修改了多模态模型训练的默认lora注入，目前对LLM和projector生效，不显著提高训练显存情况下效果更好
13. 支持PEFT0.12，并支持了新的tuner：fourierft
14. 支持多模态模型的rope-scaling
15. 支持数据集的流式处理，降低显存消耗，使用--streaming开启
16. 支持了vLLM的多模态推理部署能力
17. 对部分多模态模型支持了grounding任务

新模型
1. qwen2-audio系列模型
22. qwen2-math
23. codegeex4
24. internvl2系列模型
25. llava video
26. xcomposer2.5
27. cogvlm2-video
28. numina-math
29. mistral-nemo
30. llama3.1系列
31. mistral-large
32. gemma-2-2b
33. internlm2.5 1.8b 20b
34. minicpm-v-v2_6-chat

参考：https://swift.readthedocs.io/zh-cn/latest/LLM/%E6%94%AF%E6%8C%81%E7%9A%84%E6%A8%A1%E5%9E%8B%E5%92%8C%E6%95%B0%E6%8D%AE%E9%9B%86.html

新数据集
1. zhihu-kol和zhihu-kol-filtered数据集
3. SA1B系列中文多模态数据集

参考：https://swift.readthedocs.io/zh-cn/latest/LLM/%E6%94%AF%E6%8C%81%E7%9A%84%E6%A8%A1%E5%9E%8B%E5%92%8C%E6%95%B0%E6%8D%AE%E9%9B%86.html

What's Changed
* fix dependency by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1306
* support codegeex4 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1305
* support internvl2 by hjh0119 in https://github.com/modelscope/ms-swift/pull/1304
* support llava video by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1307
* fix docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1309
* support lr_scheduler_kwargs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1310
* Fix internvl2 template by hjh0119 in https://github.com/modelscope/ms-swift/pull/1308
* Fix bugs by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1311
* support warmup_stable_decay by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1312
* Support xcomposer2.5 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1287
* Fix bugs by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1319
* fix bug by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1320
* fix template by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1321
* support cogvlm2-video by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1318
* Fix bugs by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1325
* fix web-ui by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1327
* compatible with trl 0.9.6 by hjh0119 in https://github.com/modelscope/ms-swift/pull/1326
* compat with vllm==0.5.1 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1329
* Update qrcode by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1332
* fix florence model by hjh0119 in https://github.com/modelscope/ms-swift/pull/1334
* Relaxing requirements for trl by hjh0119 in https://github.com/modelscope/ms-swift/pull/1342
* fix xcomposer2.5 device_map by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1343
* support generation_info by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1344
* fix requirements by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1347
* readthedocs by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1345
* fix sequence parallel get labels by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1352
* fix filelock by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1354
* Add pt command by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1356
* fix generation_info efficiency by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1359
* fix sh ddp_backend by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1360
* support LLM & lmdeploy by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1272
* fix a file path by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1363
* Internvl2 support video by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1366
* fix openai api by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1367
* fix internvl2-40b by hjh0119 in https://github.com/modelscope/ms-swift/pull/1369
* fix vlm deploy lora & agent by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1371
* Support lora regex by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1375
* Fix docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1380
* Fix FSDP; Add training percentage to jsonl logging; Add a web-ui component by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1381
* Support max memory args by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1382
* fix max_memory by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1383
* Fix gpu assert calculation by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1384
* fix dataset_sample & deploy stop_words by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1385
* fix internvl doc by hjh0119 in https://github.com/modelscope/ms-swift/pull/1394
* Fix link by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1397
* fix vllm==0.5.1 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1404
* [TorchAcc] update accelerate API and add llama3-70B by baoleai in https://github.com/modelscope/ms-swift/pull/1400
* Support Ollama and BNB for export by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1407
* Fix glm4v merge lora by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1410
* [TorchAcc] fix model download when using TorchAcc distributed training by baoleai in https://github.com/modelscope/ms-swift/pull/1408
* Support padding left by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1414
* Fix ollama export by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1416
* fix web-ui params by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1417
* fix hub_token by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1420
* Update ms hub token by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1424
* Add numina math model by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1421
* fix internvl template by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1433
* Internvl series models update by hjh0119 in https://github.com/modelscope/ms-swift/pull/1426
* fix internvl2 template by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1436
* Fix bug and make lazydataset more stable by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1438
* Fix llava-hf by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1439
* [WIP]Support Q-Galore by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1440
* 1. support deepspeed on ui 2. add tools to client_utils by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1446
* fix read csv (float) by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1447
* fix dataset by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1448
* update internvl doc by hjh0119 in https://github.com/modelscope/ms-swift/pull/1449
* Support api key by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1452
* Support mistral nemo series models by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1454
* fix minicpm-v2.5 lora_target_modules by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1455
* Add two datasets by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1459
* Update trl dependency version by hjh0119 in https://github.com/modelscope/ms-swift/pull/1463
* fix bugs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1464
* fix yi1.5 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1465
* Fix yi1.5 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1467
* add activate and deactivate for part tuner by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1470
* support llama3.1 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1475
* support megatron by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1365
* fix megatron by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1476
* Support internvl2 grounding by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1473
* update doc by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1477
* Support alignment algorithm for vision MLLM by hjh0119 in https://github.com/modelscope/ms-swift/pull/1474
* fix doc by hjh0119 in https://github.com/modelscope/ms-swift/pull/1481
* Fix visual cpo by hjh0119 in https://github.com/modelscope/ms-swift/pull/1482
* support llama3.1-quant by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1478
* fix part tuner by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1483
* fix import by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1488
* Fix GLM4V by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1490
* support mistral large by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1485
* fix resume_only_model & zero3 & full by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1497
* Fix resume_from_checkpoint & full by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1498
* fix part tuner by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1495
* fix cogvlm2-video by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1500
* [TorchAcc] add script for qwen2 in torchacc by Zhikaiiii in https://github.com/modelscope/ms-swift/pull/1492
* Fix CI by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1501
* fix vlm template by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1503
* fix internvl-4b by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1505
* support zero3 & freeze by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1508
* fix part mix with lora by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1509
* fix docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1511
* Update README.md by ArtificialZeng in https://github.com/modelscope/ms-swift/pull/1516
* fix kto custom data by hjh0119 in https://github.com/modelscope/ms-swift/pull/1515
* Fix KTO doc by hjh0119 in https://github.com/modelscope/ms-swift/pull/1517
* Rescale image by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1512
* fix pretrain dataset by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1518
* fix deepseek-vl template by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1521
* Support exporting of llama3.1, and awq-batch-size by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1522
* support lmdeploy & vlm by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1364
* fix tf 4.43 llava by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1525
* fix llamapro by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1527
* fix template & docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1529
* fix lmdeploy & vlm by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1530
* update doc by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1531
* fix lmdeploy & minicpm-v-2.5 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1534
* fix internvl-phi3 batch infer by hjh0119 in https://github.com/modelscope/ms-swift/pull/1539
* Support SA1B series datasets by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1542
* fix bug in _prepare_inputs by guihonghao in https://github.com/modelscope/ms-swift/pull/1543
* Support lmdeploy infer deploy by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1541
* add lmdeploy link by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1545
* support lmdeploy & app-ui by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1546
* fix lmdeploy bug by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1550
* support more models by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1552
* fix multi node by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1554
* support lmdeploy awq by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1555
* support quant_policy by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1556
* fix xcomposer lora by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1559
* Update docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1558
* fix minicpm-v by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1562
* add result_dir paramerter to InferArgument & fix a minor bug by starxhong in https://github.com/modelscope/ms-swift/pull/1561
* fix some bugs in dpo by hjh0119 in https://github.com/modelscope/ms-swift/pull/1565
* Fix bugs 0801 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1566
* fix dataset copy by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1569
* fix qwen-vl-merged lmdeploy by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1572
* Change multi-modal default lora to llm&projector by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1571
* fix quant by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1573
* fix kto by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1575
* update docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1578
* Fix huge model saving by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1579
* Fix/0802 by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1581
* Peft 0.12 by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1586
* fix bugs in gemma2-2b-it by DaozeZhang in https://github.com/modelscope/ms-swift/pull/1587
* [TorchAcc] Update patch for transformers>=4.41.0 by baoleai in https://github.com/modelscope/ms-swift/pull/1584
* fix agent deployment by hjh0119 in https://github.com/modelscope/ms-swift/pull/1592
* support swift deploy stats by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1593
* Fix megatron convert by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1597
* add gemma-2-2b by DaozeZhang in https://github.com/modelscope/ms-swift/pull/1595
* support max_batch_size by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1599
* update docs by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1600
* support multi modal evaluation by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1540
* support internlm2.5 1.8b 20b by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1551
* support qwen1.5 megatron by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1564
* compat with peft==0.11 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1604
* Fix InternVL2 doc by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1607
* Fix rope scaling by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1610
* Fix/rope by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1612
* support minicpm-v-v2_6-chat by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1609
* Fix InternVL2-LLaMA3 by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1614
* fix rope scaling bug by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1620
* fix florence template by hjh0119 in https://github.com/modelscope/ms-swift/pull/1618
* support internlm_xcomposer2_4khd by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1622
* support vllm & vlm by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1630
* Fix ci by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1634
* Compat transformers 4.44 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1640
* fix xcomposer lora_target_modules by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1645
* fix TypeError: 'NoneType' object is not iterable, when only have video data the image is none by Wondersui in https://github.com/modelscope/ms-swift/pull/1637
* support qwen2-math by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1644
* fix peft patch by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1647
* fix oom test in rlhf by hjh0119 in https://github.com/modelscope/ms-swift/pull/1651
* Fix peft patch by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1650
* [TorchAcc] fix bcast of output_dir by baoleai in https://github.com/modelscope/ms-swift/pull/1652
* fix tp lmdeploy by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1654
* fix transformers==4.33 by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1655
* support qwen2-audio by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1633
* update aishell1 dataset by Jintao-Huang in https://github.com/modelscope/ms-swift/pull/1657
* Add OLLaMA doc by tastelikefeet in https://github.com/modelscope/ms-swift/pull/1660
* Support IterableDataset by hjh0119 in https://github.com/modelscope/ms-swift/pull/1596

New Contributors
* ArtificialZeng made their first contribution in https://github.com/modelscope/ms-swift/pull/1516
* guihonghao made their first contribution in https://github.com/modelscope/ms-swift/pull/1543
* DaozeZhang made their first contribution in https://github.com/modelscope/ms-swift/pull/1587
* Wondersui made their first contribution in https://github.com/modelscope/ms-swift/pull/1637

**Full Changelog**: https://github.com/modelscope/ms-swift/compare/v2.2.0...v2.3.0

New Features:
1. Support for RLHF with multimodal models, including DPO, ORPO, SIMPO, and CPO
2. SWIFT infer, SWIFT deploy support using lmdeploy for inference acceleration.
3. Support the use of Megatron for performing PT and SFT on the Qwen2 series models.
4. Support the grounding task for InternVL2/Qwen-VL-Chat models

New Models:
1. mistral-nemo series, mistral-large
2. llama3.1 series

New Datasets:
1. sa1b-dense-caption, sa1b-paired-caption
2. rlaif-v
3. zhihu-kol, zhihu-kol-filtered

What's Changed
* Support api key by Jintao-Huang in https://github.com/modelscope/swift/pull/1452
* Support mistral nemo series models by tastelikefeet in https://github.com/modelscope/swift/pull/1454
* fix minicpm-v2.5 lora_target_modules by Jintao-Huang in https://github.com/modelscope/swift/pull/1455
* Add two datasets by tastelikefeet in https://github.com/modelscope/swift/pull/1459
* Update trl dependency version by hjh0119 in https://github.com/modelscope/swift/pull/1463
* fix bugs by Jintao-Huang in https://github.com/modelscope/swift/pull/1464
* fix yi1.5 by Jintao-Huang in https://github.com/modelscope/swift/pull/1465
* Fix yi1.5 by Jintao-Huang in https://github.com/modelscope/swift/pull/1467
* add activate and deactivate for part tuner by tastelikefeet in https://github.com/modelscope/swift/pull/1470
* support llama3.1 by Jintao-Huang in https://github.com/modelscope/swift/pull/1475
* support megatron by Jintao-Huang in https://github.com/modelscope/swift/pull/1365
* fix megatron by Jintao-Huang in https://github.com/modelscope/swift/pull/1476
* Support internvl2 grounding by tastelikefeet in https://github.com/modelscope/swift/pull/1473
* update doc by tastelikefeet in https://github.com/modelscope/swift/pull/1477
* Support alignment algorithm for vision MLLM by hjh0119 in https://github.com/modelscope/swift/pull/1474
* fix doc by hjh0119 in https://github.com/modelscope/swift/pull/1481
* Fix visual cpo by hjh0119 in https://github.com/modelscope/swift/pull/1482
* support llama3.1-quant by Jintao-Huang in https://github.com/modelscope/swift/pull/1478
* fix part tuner by tastelikefeet in https://github.com/modelscope/swift/pull/1483
* fix import by tastelikefeet in https://github.com/modelscope/swift/pull/1488
* Fix GLM4V by tastelikefeet in https://github.com/modelscope/swift/pull/1490
* support mistral large by Jintao-Huang in https://github.com/modelscope/swift/pull/1485
* fix resume_only_model & zero3 & full by Jintao-Huang in https://github.com/modelscope/swift/pull/1497
* Fix resume_from_checkpoint & full by Jintao-Huang in https://github.com/modelscope/swift/pull/1498
* fix part tuner by tastelikefeet in https://github.com/modelscope/swift/pull/1495
* fix cogvlm2-video by Jintao-Huang in https://github.com/modelscope/swift/pull/1500
* [TorchAcc] add script for qwen2 in torchacc by Zhikaiiii in https://github.com/modelscope/swift/pull/1492
* Fix CI by tastelikefeet in https://github.com/modelscope/swift/pull/1501
* fix vlm template by Jintao-Huang in https://github.com/modelscope/swift/pull/1503
* fix internvl-4b by Jintao-Huang in https://github.com/modelscope/swift/pull/1505
* support zero3 & freeze by Jintao-Huang in https://github.com/modelscope/swift/pull/1508
* fix part mix with lora by tastelikefeet in https://github.com/modelscope/swift/pull/1509
* fix docs by Jintao-Huang in https://github.com/modelscope/swift/pull/1511
* Update README.md by ArtificialZeng in https://github.com/modelscope/swift/pull/1516
* fix kto custom data by hjh0119 in https://github.com/modelscope/swift/pull/1515
* Fix KTO doc by hjh0119 in https://github.com/modelscope/swift/pull/1517
* Rescale image by tastelikefeet in https://github.com/modelscope/swift/pull/1512
* fix pretrain dataset by Jintao-Huang in https://github.com/modelscope/swift/pull/1518
* fix deepseek-vl template by Jintao-Huang in https://github.com/modelscope/swift/pull/1521
* Support exporting of llama3.1, and awq-batch-size by tastelikefeet in https://github.com/modelscope/swift/pull/1522
* support lmdeploy & vlm by Jintao-Huang in https://github.com/modelscope/swift/pull/1364
* fix tf 4.43 llava by tastelikefeet in https://github.com/modelscope/swift/pull/1525
* fix llamapro by tastelikefeet in https://github.com/modelscope/swift/pull/1527
* fix template & docs by Jintao-Huang in https://github.com/modelscope/swift/pull/1529
* fix lmdeploy & vlm by Jintao-Huang in https://github.com/modelscope/swift/pull/1530
* update doc by tastelikefeet in https://github.com/modelscope/swift/pull/1531
* fix lmdeploy & minicpm-v-2.5 by Jintao-Huang in https://github.com/modelscope/swift/pull/1534
* fix internvl-phi3 batch infer by hjh0119 in https://github.com/modelscope/swift/pull/1539
* Support SA1B series datasets by tastelikefeet in https://github.com/modelscope/swift/pull/1542
* fix bug in _prepare_inputs by guihonghao in https://github.com/modelscope/swift/pull/1543
* Support lmdeploy infer deploy by Jintao-Huang in https://github.com/modelscope/swift/pull/1541
* add lmdeploy link by Jintao-Huang in https://github.com/modelscope/swift/pull/1545
* support lmdeploy & app-ui by Jintao-Huang in https://github.com/modelscope/swift/pull/1546
* fix lmdeploy bug by Jintao-Huang in https://github.com/modelscope/swift/pull/1550
* support more models by Jintao-Huang in https://github.com/modelscope/swift/pull/1552
* fix multi node by tastelikefeet in https://github.com/modelscope/swift/pull/1554
* support lmdeploy awq by Jintao-Huang in https://github.com/modelscope/swift/pull/1555
* support quant_policy by Jintao-Huang in https://github.com/modelscope/swift/pull/1556
* fix xcomposer lora by Jintao-Huang in https://github.com/modelscope/swift/pull/1559
* Update docs by Jintao-Huang in https://github.com/modelscope/swift/pull/1558
* fix minicpm-v by Jintao-Huang in https://github.com/modelscope/swift/pull/1562
* add result_dir paramerter to InferArgument & fix a minor bug by starxhong in https://github.com/modelscope/swift/pull/1561
* fix some bugs in dpo by hjh0119 in https://github.com/modelscope/swift/pull/1565
* Fix bugs 0801 by Jintao-Huang in https://github.com/modelscope/swift/pull/1566
* fix dataset copy by Jintao-Huang in https://github.com/modelscope/swift/pull/1569
* fix qwen-vl-merged lmdeploy by Jintao-Huang in https://github.com/modelscope/swift/pull/1572

New Contributors
* ArtificialZeng made their first contribution in https://github.com/modelscope/swift/pull/1516
* guihonghao made their first contribution in https://github.com/modelscope/swift/pull/1543

**Full Changelog**: https://github.com/modelscope/swift/compare/v2.2.3...v2.2.5