Spacy-transformers

Latest version: v1.3.5

Safety actively analyzes 688486 Python packages for vulnerabilities to keep your Python projects secure.

Scan your dependencies

Page 6 of 8

1.0.0rc0

> 🌙 **This release is a pre-release and requires [spaCy v3](https://nightly.spacy.io/usage/v3) (nightly).**

✨ New features and improvements

- Rewrite library from scratch for spaCy v3.0.
- `Transformer` component for easy pipeline integration.
- `TransformerListener` to share transformer weights between components.
- Built-in registered functions that are available in spaCy if `spacy-transformers` is installed in the same environment.

📖 Documentation

- [Embeddings, Transformers and Transfer Learning](https://nightly.spacy.io/usage/embeddings-transformers): How to use transformers in spaCy
- [Training Pipelines and Models](https://nightly.spacy.io/usage/training):
Train and update components on your own data and integrate custom models
- [Layers and Model Architectures](https://nightly.spacy.io/usage/layers-architectures):
Power spaCy components with custom neural networks
- [`Transformer`](https://nightly.spacy.io/api/transformer): Pipeline component API reference
- [Transformer architectures](https://nightly.spacy.io/api/architectures#transformers): Architectures and registered functions

0.6.2

* Fix issue 204: Store model_type in tok2vec config to fix speed degradation

0.6.1

> ⚠️ This release requires downloading new models.

* Update `spacy-transformers` for spaCy v2.3
* Update and extend supported `transformers` versions to `>=2.4.0,<2.9.0`
* Use `transformers.AutoConfig` to support loading pretrained models from https://huggingface.co/models
* 123: Fix alignment algorithm using [`pytokenizations`](https://github.com/tamuhey/tokenizations)

Thanks to tamuhey for the pull request!

0.6.0

Update to newer version of `transformers`.

This library is being rewritten for spaCy v3, in order to improve its flexibility and performance and to make it easier to stay up to date with new transformer models. See here for details: https://github.com/explosion/spacy-transformers/pull/173

0.5.3

Bug fixes related to alignment and truncation:

* 191: Reset max_len in case of alignment error
* 196: Fix wordpiecer truncation to be per sentence

Enhancement:

* 162: Let nlp.update handle Doc type inputs

Thanks to ZhuoruLin for the pull requests and helping us debug issues related to batching and truncation!

0.5.2

Fix various alignment and preprocessing bugs.

Page 6 of 8

© 2024 Safety CLI Cybersecurity Inc. All Rights Reserved.