D2vg

We are proud to announce the release of 1.0.0! 🎉🎊

What's new in this release:
- Introducing parallel processing to parse document files (-j)
- Stabilized search results (fixed wrong argument of infer_vector)
- Updating the algorithm for extracting headings
- Utilize optimized options of Janome tokenizer (-l ja)

Doc2Vec model files:
- en https://github.com/tos-kamiya/d2vg/releases/download/v0.8.0/enwiki-m700-c380-d100.tar.bz2
- ja https://github.com/tos-kamiya/d2vg/releases/download/v1.0.0-rc.2/jawiki-janome-m100-c400-d100.tar.bz2 (revised in this release)
- ko https://github.com/tos-kamiya/d2vg/releases/download/v0.8.0/kowiki-m50-c400-d100.tar.bz2
- zh https://github.com/tos-kamiya/d2vg/releases/download/v0.8.0/zhwiki-m100-c400-d100.tar.bz2

**Full Changelog**: https://github.com/tos-kamiya/d2vg/compare/v0.8.0...v1.0.0-rc.2

What's new:
- Easier to install
- Improved display of search results
- Tuning of Doc2Vec models
- Enhanced error messages

(Note: For Japanese, be sure to use the new Doc2Vec model, as the tokenizer has changed since 0.7.0.)
(注意: 日本語に関してはトークナイザーが0.7.0から変更されているので、必ず新しいDoc2Vecモデルを利用してください。)

Doc2Vec models can be found below: <language>... *.bz2 file.

**Full Changelog**: https://github.com/tos-kamiya/d2vg/compare/v0.7.0...v0.8.0

What's new in this release:
- Experimental support for languages: ko, zh

Honestly, I can't read or write Chinese and Korean languages, so I am not sure about the accuracy of the models. Any comments, patches, or tuned models are welcome :)

To install, follow the instructions at https://github.com/tos-kamiya/d2vg#installation.

For the `en` and `ja` Doc2Vec model files (`enw50k.*`, `jaw50k.*`), please use the same files as in v0.5.1's assets:
[enw50k.tar.bz2.aa](https://github.com/tos-kamiya/d2vg/releases/download/v0.5.1/enw50k.tar.bz2.aa), [enw50k.tar.bz2.ab](https://github.com/tos-kamiya/d2vg/releases/download/v0.5.1/enw50k.tar.bz2.ab), [jaw50k.tar.bz2](https://github.com/tos-kamiya/d2vg/releases/download/v0.5.1/jaw50k.tar.bz2)

For `ko` and `zh` Doc2Vec model files are available at this release's assets.

Note: There is an ongoing attempt to refine the en and ja Doc2Vec models, based on feedback from the experience of adding the zh and ko Doc2Vec models. The v0.7.0 might be a short-term release.

**Full Changelog**: https://github.com/tos-kamiya/d2vg/compare/v0.6.0...v0.7.0