Pythainlp

**What is change?**
- Fixed bug 828. Thank you tonezzz for reporting!

**Full Changelog**: https://github.com/PyThaiNLP/pythainlp/compare/v4.1.0-beta1...v4.1.0-beta2

**Schedule**
- First Beta release: 24 July 2023

Docs: https://pythainlp.github.io/dev-docs/
Report bug: https://github.com/PyThaiNLP/pythainlp/issues

Install: `pip install --pre pythanlp`

See [4.1 Milestone](https://github.com/PyThaiNLP/pythainlp/milestone/18).

What is new?
Deprecation and other API changes
- https://github.com/PyThaiNLP/pythainlp/commit/5e97e7c4ebcf68bca64e4f942c8dfe3a5ab2ebc5 Change the default NER to thainer-v2

New API
- Add pythainlp.coref: Add pythainlp.coref for support Thai Coreference resolution 802
- Add wtpsplit to sentence segmentation & paragraph segmentation 804 and add paragraph_threshold into paragraph_tokenize function 806
- Add word approximation to pythainlp.soundex.sound by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/809
- Add pythainlp.wsd for Thai Word Sense Disambiguation by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/818
- Add pythainlp.chat and WangChanGLM to pythainlp.generate by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/819
- Add a param-free classification model (`pythainlp.cls`) by c4n in https://github.com/PyThaiNLP/pythainlp/pull/821
- Add pythainlp.el by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/822
- Add pythainlp.util.abbreviation_to_full_text 826 by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/826


Tokenizer
- Add wtpsplit engine to sentence_tokenize 804
- New `paragraph_tokenize` funtion to split Thai text to a paragraph. 804
- add `paragraph_threshold` into `paragraph_tokenize` function by pavaris-pm in https://github.com/PyThaiNLP/pythainlp/pull/806

Translate
- Add small100 to pythainlp.translate by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/815

Corpus
- Add orst list by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/810
- Add thai_synonym 825 by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/825

Util
- Add pythainlp.util.encoding by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/813
- Add pythainlp.util.spell_words by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/817
- Add pythainlp.util.abbreviation_to_full_text 826 by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/826

New Contributors
* pavaris-pm made their first contribution in https://github.com/PyThaiNLP/pythainlp/pull/806
* falukelo made their first contribution in https://github.com/PyThaiNLP/pythainlp/pull/824

**Full Changelog**: https://github.com/PyThaiNLP/pythainlp/compare/v4.0.0...v4.1.0-beta1

PyThaiNLP v4.0.2` is a bug fix release of `PyThaiNLP v4.0`.

Upgrade: `pip install -U pythainlp`


Documentation: [https://pythainlp.github.io/docs/4.0](https://pythainlp.github.io/docs/4.0)

Report bug: https://github.com/PyThaiNLP/pythainlp/issues


See [PyThaiNLP 4.0 Change Log](https://github.com/PyThaiNLP/pythainlp/issues/714)

What's Changed
* fixed bug by kangkengkhadev in https://github.com/PyThaiNLP/pythainlp/pull/798
* fig เอือน อวน by kangkengkhadev in https://github.com/PyThaiNLP/pythainlp/pull/799


**Full Changelog**: https://github.com/PyThaiNLP/pythainlp/compare/v4.0.1...v4.0.2

Contributors

<a href="https://github.com/PyThaiNLP/pythainlp/graphs/contributors">
<img src="https://contributors-img.firebaseapp.com/image?repo=PyThaiNLP/pythainlp" />
</a>

Thanks all the [contributors](https://github.com/PyThaiNLP/pythainlp/graphs/contributors). (Image made with [contributors-img](https://contributors-img.firebaseapp.com))

If you want to contributing to PyThaiNLP, you can read [Contributing to PyThaiNLP](https://github.com/PyThaiNLP/pythainlp/blob/dev/CONTRIBUTING.md).

PyThaiNLP v4.0.1` is a bug fix release of `PyThaiNLP v4.0`.

Upgrade: `pip install -U pythainlp`


Documentation: [https://pythainlp.github.io/docs/4.0](https://pythainlp.github.io/docs/4.0)

Report bug: https://github.com/PyThaiNLP/pythainlp/issues


See [PyThaiNLP 4.0 Change Log](https://github.com/PyThaiNLP/pythainlp/issues/714)

What's Changed
* Fix mishandling Karun in Kavee Matra Checker by HRNPH in https://github.com/PyThaiNLP/pythainlp/pull/793
* adding tonemark removal to fix mattra checking by HRNPH in https://github.com/PyThaiNLP/pythainlp/pull/795


**Full Changelog**: https://github.com/PyThaiNLP/pythainlp/compare/v4.0.0...v4.0.1

Contributors

<a href="https://github.com/PyThaiNLP/pythainlp/graphs/contributors">
<img src="https://contributors-img.firebaseapp.com/image?repo=PyThaiNLP/pythainlp" />
</a>

Thanks all the [contributors](https://github.com/PyThaiNLP/pythainlp/graphs/contributors). (Image made with [contributors-img](https://contributors-img.firebaseapp.com))

If you want to contributing to PyThaiNLP, you can read [Contributing to PyThaiNLP](https://github.com/PyThaiNLP/pythainlp/blob/dev/CONTRIBUTING.md).

**Full Changelog**: https://github.com/PyThaiNLP/pythainlp/compare/v3.1.0...v4.0.0

Contributors

<a href="https://github.com/PyThaiNLP/pythainlp/graphs/contributors">
<img src="https://contributors-img.firebaseapp.com/image?repo=PyThaiNLP/pythainlp" />
</a>

Thanks all the [contributors](https://github.com/PyThaiNLP/pythainlp/graphs/contributors). (Image made with [contributors-img](https://contributors-img.firebaseapp.com))

If you want to contributing to PyThaiNLP, you can read [Contributing to PyThaiNLP](https://github.com/PyThaiNLP/pythainlp/blob/dev/CONTRIBUTING.md).


New Contributors
* LXZE made their first contribution in https://github.com/PyThaiNLP/pythainlp/pull/742
* new5558 made their first contribution in https://github.com/PyThaiNLP/pythainlp/pull/746
* PhakphumV made their first contribution in https://github.com/PyThaiNLP/pythainlp/pull/770
* kangkengkhadev made their first contribution in https://github.com/PyThaiNLP/pythainlp/pull/777
* HRNPH made their first contribution in https://github.com/PyThaiNLP/pythainlp/pull/779

PyThaiNLP published [the first version is 0.0.4 to PyPI at 6 years ago](https://pypi.org/project/pythainlp/0.0.4/), so PyThaiNLP 4.0 will have special codename. The codename for PyThaiNLP 4.0 is **PyThaiNLP 4.0 (Real)**.

See [4.0 Milestone](https://github.com/PyThaiNLP/pythainlp/milestone/17).

Documentation: [https://pythainlp.github.io/docs/4.0](https://pythainlp.github.io/docs/4.0)

Report bug: https://github.com/PyThaiNLP/pythainlp/issues


See [PyThaiNLP 4.0 Change Log](https://github.com/PyThaiNLP/pythainlp/issues/714)


If you want to contribute to PyThaiNLP, you can read [Contributing to PyThaiNLP](https://github.com/PyThaiNLP/pythainlp/blob/dev/CONTRIBUTING.md).

What is new?
Deprecation and other API changes
- Delete all LST20 model 728
- https://github.com/PyThaiNLP/pythainlp/commit/947c7be9ce4199af58ecf042629dda4d752dbcd6 Change pythainlp.tools.misspell to pythainlp.tools.misspell.misspell

Improve
- Reduce import time 719
- Fix/broken numeric data format (652) 723

Tokenizer
- Add blackboard cls 732
- Add <Karan> rule to TCC and Change TCC rule for newmm 741

Tag
- Add blackboard pos_tag 733
- Add ThaiNER 2.0 781

Util
- Add pythainlp.util.count_thai_chars 748
- Add thai_strptime and convert_years 767

Transliterate
- Add Thai2Rom ONNX model 743

Khavee
- add khavee to pythainlp 777
- add aek/too checker function to khavee 779

Parse
- Add ud_goeswith 757

Corpus
- Add new science word 763

Full Changelog
* Improve: Reduce import time by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/719
* Create CITATION.cff by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/721
* Fix/broken numeric data format (652) by noppayut in https://github.com/PyThaiNLP/pythainlp/pull/723
* Add blackboard pos_tag to cls by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/734
* Update perceptron.py by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/736
* Feature/integrate transliteration dictionary (681) by noppayut in https://github.com/PyThaiNLP/pythainlp/pull/735
* Delete all LST20 model by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/728
* Add blackboard cls by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/732
* Add blackboard pos_tag by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/733
* Add style.css: extend docs page width by LXZE in https://github.com/PyThaiNLP/pythainlp/pull/742
* Add <Karan> rule to TCC and Change TCC rule for newmm by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/741
* Setup action to check for code formatting by new5558 in https://github.com/PyThaiNLP/pythainlp/pull/746
* Add more test for TCC by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/747
* Add Thai2Rom ONNX model by new5558 in https://github.com/PyThaiNLP/pythainlp/pull/743
* Add pythainlp.util.count_thai_chars by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/748
* Feature: keyword extraction with keybert and frequency ranking by noppayut in https://github.com/PyThaiNLP/pythainlp/pull/751
* Add ud_goeswith by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/757
* Bump tensorflow from 2.7.2 to 2.9.3 by dependabot in https://github.com/PyThaiNLP/pythainlp/pull/758
* Add new science word by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/763
* Add thai_strptime and convert_years by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/767
* Fix typo in thai_full_month_lists for February by PhakphumV in https://github.com/PyThaiNLP/pythainlp/pull/770
* Add pythainlp.util.phoneme by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/772
* Add remove tone ipa by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/776
* add khavee to pythainlp by kangkengkhadev in https://github.com/PyThaiNLP/pythainlp/pull/777
* Add khavee docs tests by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/778
* add aek/too checker function to khavee by HRNPH in https://github.com/PyThaiNLP/pythainlp/pull/779
* Add Thai NER 2.0 by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/781
* Add Copyright to the header files by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/782
* Fixed some issues in Khavee. It's a problem with use อ by kangkengkhadev in https://github.com/PyThaiNLP/pythainlp/pull/785
* PyThaiNLP 4.0 beta 1 by wannaphong in https://github.com/PyThaiNLP/pythainlp/pull/786
* fix some bugs and add check_karu_lahu function by kangkengkhadev in https://github.com/PyThaiNLP/pythainlp/pull/787