- Add all pairs of Wikimatrix -- 1,617 of them - Add support for specifying `cols` of `.tsv` file - Add all Europarlv7 sets - Remove hin-eng `dict` from JoshuaIndianParallelCorpus - Remove Wikimatrix1 from statmt -- they are moved to separate file
----
0.2.4
- File locking using portalocker to deal with race conditions when multiple `mtdata get` are invoked in parallel - Remove language name from local file name -- as a same tar file can be used by many languages, and they dont need copy - CLI to print version name - Added KFTT Japanese-English set
----
0.2.3
- IITB hin-eng datasets - Fix issue with dataset counting
----
0.2.2
Not secure
- Pypi release bug fix: select all nested packages - add UnitedNations test set
----
0.2.1
Not secure
- Add JW300 Corpus
----
0.2.0
Not secure
- All Languages are internally mapped to 3 letter codes of ISO codes - 53,000 entries from OPUS are indexed