Spacy-llm

🔴 Bug fixes

- Llama 2 init doesn't use `use_auth_token=True` by default anymore (325)
- Anthropic requests include a `anthropic_version` header (325)

Both bugs couldn't be reproduced on our end, so we can't guarantee that these bugs are fixed now. https://github.com/explosion/spacy-llm/issues/323 and https://github.com/explosion/spacy-llm/discussions/324 for a follow-up.

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.6.0.

👥 Contributors

honnibal, ines, rmitsch

✨ New features and improvements

- **NEW**: Native REST support for...
- PaLM (305)
- Azure OpenAI (316)
- Mistral 7B (313)
- OpenAI `gpt-3.5-turbo-instruct` - supports batching! (300)
- Support `langchain==0.0.302` (308)

🔴 Bug fixes

- Hugging Face models return just the prompt response instead of prompt + prompt response (315)

⚠️ Backwards incompatibilities

No backwards incompatibilities w.r.t. v0.5.x.

📖 Documentation and examples

- New usage example for `spacy.NER.v3` with Dolly (302)

👥 Contributors

honnibal, ines, rmitsch

🔴 Bug fixes

- Fix Fix `confection` dependency pin (290)

✨ New features and improvements

- **NEW**: More accurate [Chain-of-Thought (CoT) NER](https://spacy.io/api/large-language-models#ner-v3) prompting with `spacy.NER.v3`(180)
- **NEW**: Task-specific [component factories](https://spacy.io/api/large-language-models#config) for `llm_ner` , `llm_spancat`, `llm_rel`,`llm_textcat` , `llm_sentiment`, `llm_summarization`(243, 283)
- **NEW**: Implementation of `add_label` functionality to more easily work with an `llm` component directly in Python code and not (necessarily) through the config system (277)
- New `v2` model versions for the OpenAI models that set [reasonable defaults](https://spacy.io/api/large-language-models#models-rest) for `temperature` and `max_tokens` (236)
- Functionality to ignore occassional blocking errors from Cohere (233)
- Support for Pydantic v1 and v2 (261, 275)
- Internal refactoring, including renaming of v1 Jinja templates (242)
- Empty the cache of `torch.cuda` in between calls (242)
- Various improvements to the test suite and CI

🔴 Bug fixes

- Fix Anthropic chat endpoints (230)

⚠️ Backwards incompatibilities

- Though significant refactoring of internal modules has happened, this release should not introduce any backwards incompatibilities for user-facing functionality.
- Check our [migration guide](https://github.com/explosion/spacy-llm/blob/main/migration_guide.md#04x-to-05x) if you want to update the SpanCat or NER task from `v1` or `v2` to `v3`.

📖 Documentation and examples

- Updated [usage](https://spacy.io/usage/large-language-models) documentation
- Updated [API](https://spacy.io/api/large-language-models) documentation
- New Chain-of-Though [example](https://github.com/explosion/spacy-llm/tree/main/usage_examples/ner_v3_openai) with GPT 3.5
- New `textcat` [example](https://github.com/explosion/spacy-llm/tree/main/usage_examples/textcat_dolly) with Dolly

👥 Contributors

adrianeboyd, honnibal, ines, kabirkhan, ljvmiranda921, rmitsch, svlandeg, victorialslocum, vinbo8

:sparkles: New features and improvements
- NEW: Support for LLama 2 via Huggingface (225)
- NEW: Support for Anthropic's Claude 2 (231)

🔴 Bug fixes
- Corrects how runtime arguments are passed to Falcon (222)
- Fixes incorrect capitalization in example in readme (227)

📖 Documentation and examples
We've moved most of our documentation to the main spaCy docs:
- Usage pages: https://spacy.io/usage/large-language-models
- API pages: https://spacy.io/api/large-language-models

👥 Contributors
honnibal, ines, koaning, rmitsch, svlandeg, victorialslocum

🔴 Bug fixes
- Guard REL against entity indices higher than the total number of entities available (219)
- Warn instead of raising an error when API credentials are wrong for REST-based models (218)

👥 Contributors
honnibal, ines, rmitsch, svlandeg