Spacy-llm

🔴 Bug fixes

- Remove misguided check for fixed endpoints in OpenAI REST implementation (429)
- Fix bug in EL task if non-highlighted entities are in text (375)
- Update `langchain` integration to support `langchain` >= 0.1, < 0.2 (433)

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.7.0.

📖 Documentation and examples

- Link task mentions in readme to docs (421)

👥 Contributors

honnibal, ines, magdaaniol, rmitsch, svlandeg

✨ New features and improvements

- **NEW**: Support arbitrarily long docs leveraging map-reduce and document sharding. Read more [here](https://spacy.io/api/large-language-models#task-sharding) (332)
- **NEW**: New tasks -
- `EntityLinkingTask`: use LLMs to link entity mentions in texts to entities in a custom knowledge base. Read more [here](https://spacy.io/api/large-language-models#nel) (241)
- `TranslationTask`: translate documents from and to arbitrary languages. Read more [here](https://spacy.io/api/large-language-models#translation) (396)
- `RawTask`: prompt models with only doc content, no prompt scaffolding, for a maximum of flexibility. Read more [here](https://spacy.io/api/large-language-models#raw) (395)
- Allow custom endpoints for all models to support usage of fine-tuned models (390)

🔴 Bug fixes

- Fix issues with previously incomplete integration of LangChain objects (417)

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.6.x.

📖 Documentation and examples

- Descriptions of `EntityLinkingTask`, `TranslationTask`and `RawTask` (https://github.com/explosion/spaCy/pull/12988, https://github.com/explosion/spaCy/pull/13183, https://github.com/explosion/spaCy/pull/13180)
- Introduction to and description of doc sharding/map-reduce for the support of infinitely long docs (https://github.com/explosion/spaCy/pull/13214)

👥 Contributors

honnibal, ines, rmitsch, svlandeg

🔴 Bug fixes

- Fix `langchain` model init for models not expecting `model_name` as model ID arg (374)
- Ignore Pydantic deprecation warnings stemming from `torch` (375)

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.6.0.

👥 Contributors

honnibal, ines, shadeMe, rmitsch

✨ New features and improvements

- Scoring support for sentiment task (331)
- Add label definitions for `LabeledTasks` (340)
- Support `langchain` 0.0.335 (365)
- Support new OpenAI models by allowing arbitrary model names for existing model families (356)

🔴 Bug fixes

- Fix REL prompt generation outputting internal IDs instead of string values for labels (367)
- Fix device handling for HF models, allow passing `torch_dtype` in config (359)
- Fix incorrect base URL for Azure OpenAI models (337)

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.6.0.

👥 Contributors

habibhaidari1, honnibal, ines, shadeMe, rmitsch, svlandeg, viveksilimkhan1

🔴 Bug fixes

- Anthropic requests include a `anthropic-version` header (instead of `anthropic_version`) (328)

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.6.0.

👥 Contributors

honnibal, ines, rmitsch

🔴 Bug fixes

- Llama 2 init doesn't use `use_auth_token=True` by default anymore (325)
- Anthropic requests include a `anthropic_version` header (325)

Both bugs couldn't be reproduced on our end, so we can't guarantee that these bugs are fixed now. https://github.com/explosion/spacy-llm/issues/323 and https://github.com/explosion/spacy-llm/discussions/324 for a follow-up.

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.6.0.

👥 Contributors

honnibal, ines, rmitsch