Langkit

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- Update response consistency notebook example to use GPT 3.5 247 [jamie256]
- response hallucination - expose error caught when calling openai 246 [FelipeAdachi]
- Add configurable detoxify models to toxicity module 224 [FelipeAdachi]
- Bump version to 0.0.30 229 [w0-automator]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- injections - remove faiss dependency, embeddings v2 227 [FelipeAdachi]
- Bump version to 0.0.29 219 [w0-automator]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- Add vader_sentiment support 218 [jamie256]
- deprecate OpenAIDavinci and add OpenAILegacy 216 [FelipeAdachi]
- Add PII module 217 [FelipeAdachi]
- Injections example - replacing deprecated openai model 214 [FelipeAdachi]
- Adds example segmenting on a validation column produced post-UDF 153 [richard-rogers]
- Jailbreak and Prompt Injection Example Notebook 211 [FelipeAdachi]
- Bump version to 0.0.28 210 [w0-automator]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- Update description, minor cleanup of README.md and tests 209 [jamie256]
- Openai client compatibility with both v0 and v1 208 [FelipeAdachi]
- Proactive Injection Detection 201 [FelipeAdachi]
- better prompt for llm consistency check 206 [FelipeAdachi]
- add extract scenario to Logging_Text.ipynb 203 [FelipeAdachi]
- Bump version to 0.0.27 202 [w0-automator]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- Feature extraction - wrapper around schema.apply_udf 198 [FelipeAdachi]
- CUDA benchmarks 194 [richard-rogers]
- Bump version to 0.0.26 200 [w0-automator]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- Add support for Azure OpenAI hosted models 199 [jamie256]
- Control GPU usage in injections module 193 [richard-rogers]
- Bump version to 0.0.25 192 [w0-automator]