Hanlp

We are proud to announce the beta release of HanLP 2.1, which now offers 10 joint tasks on 104 languages: tokenization, lemmatization, part-of-speech tagging, token feature extraction, dependency parsing, constituency parsing, semantic role labeling, semantic dependency parsing, abstract meaning representation (AMR) parsing.

We are proud to announce the release of HanLP 2.1, which now offers 10 joint tasks on 104 languages: tokenization, lemmatization, part-of-speech tagging, token feature extraction, dependency parsing, constituency parsing, semantic role labeling, semantic dependency parsing, abstract meaning representation (AMR) parsing.

- Easy model building and serving with TensorFlow 2.0 and Keras.
- Multilingual Support.
- Tokenization, Part-of-Speech Tagging, Named Entity Recognition, Syntactic & Semantic Dependency Parsing, Document Classification via one unified interface.

Currently, HanLP 2.0 is in alpha stage with more killer features on the roadmap. For news and updates, join our [forum](https://bbs.hankcs.com/).

* 将<>视作分隔符 fix https://bbs.hankcs.com/t/topic/4527
* Segment 添加是否进行 Normalize 的配置方法 close https://github.com/hankcs/HanLP/issues/1714
* 修复文本推荐的评分器分数计算时 scorer.boost 的 bug fix: https://github.com/hankcs/HanLP/issues/1718
* bugfix: 修复 bintrie 树全分词时 提前跳出循环 bug by carl10086 in https://github.com/hankcs/HanLP/pull/1775
* 自定义词典支持.tsv格式 fix: https://github.com/hankcs/HanLP/issues/1785
* 修复自定义词典路径传参 fix: https://github.com/hankcs/HanLP/issues/1799
* 为DoubleArrayTrie增加enableFastBuild by qiangwang in https://github.com/hankcs/HanLP/pull/1805
* 数据包兼容[data-for-1.7.5.zip](https://file.hankcs.com/hanlp/data-for-1.7.5.zip)` md5=1d9e1be4378b2dbc635858d9c3517aaa`
* Portable版同步升级到v1.8.4

xml
<dependency>
<groupId>com.hankcs</groupId>
<artifactId>hanlp</artifactId>
<version>portable-1.8.4</version>
</dependency>


:tada:感谢所有在issue中提出宝贵建议的用户！

New Contributors
* carl10086 made their first contribution in https://github.com/hankcs/HanLP/pull/1775
* qiangwang made their first contribution in https://github.com/hankcs/HanLP/pull/1805

**Full Changelog**: https://github.com/hankcs/HanLP/compare/v1.8.3...v1.8.4

* 修复动态自定义词典与CustomDictionaryForcing的搭配问题 fix https://github.com/hankcs/HanLP/issues/1712
* 调整`莎=sha1,suo1` fix https://github.com/hankcs/HanLP/issues/1670
* 根据总词频动态决定未登录词的默认词频
* DoubleArrayTrie里的LongestSearcher的next支持null作为值 by tiandiweizun in https://github.com/hankcs/HanLP/pull/1674
* Update DoubleArrayTrie.java的注释 by TITC in https://github.com/hankcs/HanLP/pull/1699
* 数据包兼容[data-for-1.7.5.zip](https://file.hankcs.com/hanlp/data-for-1.7.5.zip)` md5=1d9e1be4378b2dbc635858d9c3517aaa`
* Portable版同步升级到v1.8.3

xml
<dependency>
<groupId>com.hankcs</groupId>
<artifactId>hanlp</artifactId>
<version>portable-1.8.3</version>
</dependency>

**Full Changelog**: https://github.com/hankcs/HanLP/compare/v1.8.2...v1.8.3

New Contributors
* TITC made their first contribution in https://github.com/hankcs/HanLP/pull/1699

:tada:感谢所有在issue中提出宝贵建议的用户！