Ginza

Latest version: v5.2.0

Safety actively analyzes 623567 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 1 of 5

5.2.0

5.1.3

What's Changed
* Migrate to spaCy v3.6
* Beta release of `ja_ginza_bert_large`

**Full Changelog**: https://github.com/megagonlabs/ginza/compare/v5.1.2...v5.1.3

How to Use `ja_ginza_bert_large` β1
* Prepare
Create a virtual-env to separate `ja_ginza_bert_large` from other GiNZA model environments.
(`ja_ginza_bert_large` requires the latest `spacy-transformers` version which is not compatible with `ja_ginza` or `ja_ginza_electra`)
Console
$ python -m venv venv_bert_large
$ source venv_bert_large/bin/activate


* Install
Console
$ pip install "https://github.com/megagonlabs/ginza/releases/download/v5.1.3/ja_ginza_bert_large-5.1.3b1-py3-none-any.whl"


For CUDA environments, you need to upgrade spacy with CUDA version number as follows:
Console
$ pip install -U spacy[cuda117]


* Analyze
Console
$ ginza -g 0 -b ja_ginza_bert_large
銀座でランチをご一緒しましょう。
text = 銀座でランチをご一緒しましょう。
1 銀座 銀座 PROPN 名詞-固有名詞-地名-一般 _ 6 obl _ SpaceAfter=No|BunsetuBILabel=B|BunsetuPositionType=SEM_HEAD|NP_B|Reading=ギンザ|NE=B-GPE|ENE=B-City
2 で で ADP 助詞-格助詞 _ 1 case _ SpaceAfter=No|BunsetuBILabel=I|BunsetuPositionType=SYN_HEAD|Reading=デ
3 ランチ ランチ NOUN 名詞-普通名詞-一般 _ 6 obj _ SpaceAfter=No|BunsetuBILabel=B|BunsetuPositionType=SEM_HEAD|NP_B|Reading=ランチ
4 を を ADP 助詞-格助詞 _ 3 case _ SpaceAfter=No|BunsetuBILabel=I|BunsetuPositionType=SYN_HEAD|Reading=ヲ
5 ご ご NOUN 接頭辞 _ 6 compound _ SpaceAfter=No|BunsetuBILabel=B|BunsetuPositionType=CONT|Reading=ゴ
6 一緒 一緒 VERB 名詞-普通名詞-サ変可能 _ 0 root _ SpaceAfter=No|BunsetuBILabel=I|BunsetuPositionType=ROOT|Reading=イッショ
7 し する AUX 動詞-非自立可能 _ 6 aux _ SpaceAfter=No|BunsetuBILabel=I|BunsetuPositionType=SYN_HEAD|Inf=サ行変格,連用形-一般|Reading=シ
8 ましょう ます AUX 助動詞 _ 6 aux _ SpaceAfter=No|BunsetuBILabel=I|BunsetuPositionType=SYN_HEAD|Inf=助動詞-マス,意志推量形|Reading=マショウ
9 。 。 PUNCT 補助記号-句点 _ 6 punct _ SpaceAfter=No|BunsetuBILabel=I|BunsetuPositionType=CONT|Reading=。

5.1.2

What's Changed
* add pytest github actions workflow by r-terada in https://github.com/megagonlabs/ginza/pull/241
* Migrate to spaCy v3.4 by hiroshi-matsuda-rit in https://github.com/megagonlabs/ginza/pull/250

New Contributors
* ftnext made their first contribution in https://github.com/megagonlabs/ginza/pull/239
* wafuwafu13 made their first contribution in https://github.com/megagonlabs/ginza/pull/244

**Full Changelog**: https://github.com/megagonlabs/ginza/compare/v5.1.1...v5.1.2

5.1.1

What's Changed
* auto deploy for pypi by nimiusrd in https://github.com/megagonlabs/ginza/pull/184
* modify github actions: trigger by tagging, stop uploading test pypi by r-terada in https://github.com/megagonlabs/ginza/pull/233

New Contributors
* sinozu made their first contribution in https://github.com/megagonlabs/ginza/pull/230
* wataruhashimoto52 made their first contribution in https://github.com/megagonlabs/ginza/pull/236

**Full Changelog**: https://github.com/megagonlabs/ginza/compare/v5.1.0...v5.1.1

5.1.0

- 2021-12-10, Euclase
- Important changes
- Upgrade: spaCy v3.2 and Sudachi.rs(SudachiPy v0.6.2)
- Change token information fields 208 209
- `doc.user_data[“reading_forms”][token.i]` -> `token.morph.get(“Reading”)`
- `doc.user_data[“inflections”][token.i]` -> `token.morph.get(“Inflection”)`
- `force_using_normalized_form_as_lemma(True)` -> `token.norm_`
- All spaCy models, including non-Japanese, are now available with the ginza command 217
- Download and analyze the model at once by specifying the model name in the following form 219
- `ginza -m en_core_web_md`
- `ginza -f json` option always analyze the line which starts with `` regardless the option value of `-c`. 215
- Improvements
- Batch analysis processing speeds up by 50-60% in GPU environment and 10-40% in CPU environment
- Improved processing efficiency of parallel execution options (`ginza -p {n_process}` and `ginzame`) of ginza command 204
- add tests 198 210 214
- add benchmark 207 220

5.0.3

- 2021-10-15
- Bug fix
- `Bunsetu span should not cross the sentence boundary` 195

Page 1 of 5

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.