Modelscope

English Version

Dataset features
* Load repo files downloaded by `modelscope download --dataset` with `MsDataset.load`

New models

| No. | Model-id and links |
| --- | --- |
| 1 | [Facial 68 landmark detection](https://modelscope.cn/models/Damo_XR_Lab/cv_human_68-facial-landmark-detection) |

Chinese Version

数据集
* 对于使用modelscope命令行`modelscope download --dataset`下载的数据集，支持使用`MsDataset.load`加载

新模型

| No. | Model-id and links |
| --- | --- |
| 1 | [真人人脸68个关键点检测](https://modelscope.cn/models/Damo_XR_Lab/cv_human_68-facial-landmark-detection) |


What's Changed
* Fix page in list_repo by wangxingjun778 in https://github.com/modelscope/modelscope/pull/938

* fix file download off by one bug by liuyhwangyh in https://github.com/modelscope/modelscope/pull/943
* fix compatible of origin command line by liuyhwangyh in https://github.com/modelscope/modelscope/pull/944
* fix docs build by yingdachen in https://github.com/modelscope/modelscope/pull/947
* Fix streaming load issues by wangxingjun778 in https://github.com/modelscope/modelscope/pull/953
* Fix datasets issues by wangxingjun778 in https://github.com/modelscope/modelscope/pull/948
* [fix 934] allow logging level to be configurable by yingdachen in https://github.com/modelscope/modelscope/pull/958
* log download file name by yingdachen in https://github.com/modelscope/modelscope/pull/965
* Fix patching hf by tastelikefeet in https://github.com/modelscope/modelscope/pull/969
* add facial 68 landmark detection model by gylcalex1314 in https://github.com/modelscope/modelscope/pull/964
* lint code by tastelikefeet in https://github.com/modelscope/modelscope/pull/970

New Contributors
* yingdachen made their first contribution in https://github.com/modelscope/modelscope/pull/947
* gylcalex1314 made their first contribution in https://github.com/modelscope/modelscope/pull/964

**Full Changelog**: https://github.com/modelscope/modelscope/compare/v1.17.0...v1.18.0

New models
| No. | Model-id and links |
| --- | --- |
| 1 | [单目人体图像法向估计](https://www.modelscope.cn/models/Damo_XR_Lab/cv_human_monocular-normal-estimation) |

Highlight features
1. Included the --token parameter in the command line interface.
2. The snapshot_download function can be specified with parameters ignore_patterns and allowed_patterns.

What's Changed
1. Fix page in list_repo [938](https://github.com/modelscope/modelscope/pull/938)
2. Fixed the pagination bug in the dataset file download function. Integrated transformers into the framework. Added Pillow to the framework. [927](https://github.com/modelscope/modelscope/pull/927)
3. Update README_zh.md [928](https://github.com/modelscope/modelscope/pull/928)

New models
| No. | Model-id and links |
| --- | --- |
| 1 | [ERes2NetV2说话人确认-中文-通用-200k-Spkrs](https://modelscope.cn/models/iic/speech_eres2netv2_sv_zh-cn_16k-common) |



Highlight features

1. Refactor AST index file generator
2. Support swift model inference for llm pipeline
3. Refactor installation dependencies

What's Changed
* Add Eres2netv2ep4 https://github.com/modelscope/modelscope/pull/892
* Refactor AST index file generator https://github.com/modelscope/modelscope/pull/897
* Support swift model inference for llm pipeline https://github.com/modelscope/modelscope/pull/880
* Refactor installation dependencies https://github.com/modelscope/modelscope/pull/889
* Shorten check model timeout and snapshot_download file https://github.com/modelscope/modelscope/pull/896
* exchange the order of replacement https://github.com/modelscope/modelscope/pull/893
* add command line usage, optimize command line log https://github.com/modelscope/modelscope/pull/888

New models
| No. | Model-id and links |
| --- | --- |
| 1 | [TDNN说话人确认-英文-VoxCeleb-16k-离线-pytorch](https://www.modelscope.cn/models/iic/speech_tdnn_sv_en_voxceleb_16k/summary) |
| 2 | [SDPN说话人确认-英文-VoxCeleb-16k-离线-pytorch](https://www.modelscope.cn/models/iic/speech_sdpn_ecapa_tdnn_sv_en_voxceleb_16k/summary) |
| 3 | [glm-4-9b series](https://www.modelscope.cn/models/ZhipuAI/glm-4-9b/summary) |


Highlight features

1. Supports resumption of downloads from breakpoints.
2. optimized download progress bar better display granularity, better experience under low bandwidth.
3. add login and download command tool.

What's Changed
* add donwload command line and local_dir parameter liuyhwangyh in https://github.com/modelscope/modelscope/pull/866
* Download optimize liuyhwangyh in https://github.com/modelscope/modelscope/pull/862
* add sdpn and tdnn yfchenmodelscope in https://github.com/modelscope/modelscope/pull/865
* fix issue 845 liuyhwangyh in https://github.com/modelscope/modelscope/pull/861
* BUGFIX: TypeError: exceptions must derive from BaseException by AlphaHinex in https://github.com/modelscope/modelscope/pull/859
* add eres2netv2 by yfchenmodelscope in https://github.com/modelscope/modelscope/pull/830
* Fix json.decoder.JSONDecodeError when load pipeline_schema.json in https://github.com/modelscope/modelscope/pull/810
* remove necessary dependency of transformer wenmengzhou in https://github.com/modelscope/modelscope/pull/857
* update readme with latest model and github trending badage by wenmengzhou in https://github.com/modelscope/modelscope/pull/851

New Contributors
* AlphaHinex made their first contribution in https://github.com/modelscope/modelscope/pull/859

**Full Changelog**: https://github.com/modelscope/modelscope/compare/v1.14.0...v1.15.0

New models
| No. | Model-id and links |
| --- | --- |
| 1 | [Qwen1.5-110B-Chat](https://modelscope.cn/models/qwen/Qwen1.5-110B-Chat/summary) |
| 2 | [CodeQwen1.5-7B-Chat](https://modelscope.cn/models/qwen/CodeQwen1.5-7B-Chat/summary) |
| 3 | [WizardLM-2-8x22B](https://modelscope.cn/models/AI-ModelScope/WizardLM-2-8x22B/summary) |
| 4 | [c4ai-command-r-v01](https://modelscope.cn/models/AI-ModelScope/c4ai-command-r-v01/summary) |
| 5 | [通义千问1.5-32B-对话](https://modelscope.cn/models/qwen/Qwen1.5-32B-Chat/summary) |
| 6 | [dbrx-instruct](https://modelscope.cn/models/AI-ModelScope/dbrx-instruct/summary) |


Highlight features

1. Dataset refactoring, to be compatible with HF datasets structure, new to limit datasets<2.19.0 (Breaking Changes)

What's Changed
* Fix api get_dataset_file_url by wangxingjun778 in https://github.com/modelscope/modelscope/pull/811
* Feature/raft by pipikk in https://github.com/modelscope/modelscope/pull/702
* fix installation error in README_zh.md by cyx2000 in https://github.com/modelscope/modelscope/pull/821
* BUGFIX: TypeError: exceptions must derive from BaseException by joeyism in https://github.com/modelscope/modelscope/pull/816
* add eres2netv2 by yfchenmodelscope in https://github.com/modelscope/modelscope/pull/830
* add input output for siamese by WeiLai5432 in https://github.com/modelscope/modelscope/pull/810
* Fix datasets hf utils by wangxingjun778 in https://github.com/modelscope/modelscope/pull/834
* merge from release 1.13.3 by zzhangpurdue in https://github.com/modelscope/modelscope/pull/837

New Contributors
* pipikk made their first contribution in https://github.com/modelscope/modelscope/pull/702
* cyx2000 made their first contribution in https://github.com/modelscope/modelscope/pull/821
* joeyism made their first contribution in https://github.com/modelscope/modelscope/pull/816
* WeiLai5432 made their first contribution in https://github.com/modelscope/modelscope/pull/810

**Full Changelog**: https://github.com/modelscope/modelscope/compare/v1.13.2...v1.14.0