Langkit

LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- update dataset UDF to new signature 97 [richard-rogers]
- Update version to 0.0.10 108 [jamie256]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- Make LangChain metadata logging opt-in 105 [jamie256]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀
This version includes:

- Update langchain callback handler to capture metadata, correlated prompt/responses 104 [jamie256]
- Update version to 0.0.8 103 [jamie256]

🔍 LangKit: An open-source toolkit for monitoring Language Learning Models (LLMs).📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance metrics, & sentiment analysis. 📊 A comprehensive tool for LLM observability. 👀

This version includes:

- add nlp score metrics 87 [andrewelizondo]
- Add release draft template 101 [jamie256]
- doc updates - add modules table and fixes on gpt behavior example 99 [FelipeAdachi]
- Add isolated regex pattern unit tests 94 [jamie256]
- Add hugging face example 100 [sagecodes]
- Add release automation workflows 96 [jamie256]
- Add pre-commit to CI 95 [jamie256]

Hi everyone! We’ve now released the first version of LangKit 0.0.7 🚀.

LangKit is an open-source text metrics toolkit for monitoring language models. It offers an array of methods for extracting relevant signals from the input and/or output text, which are compatible with the open-source data logging library [whylogs](https://whylogs.readthedocs.io/en/latest).

💡 Want to experience LangKit? Go to this [notebook](https://github.com/whylabs/langkit/blob/main/langkit/examples/Intro_to_Langkit.ipynb)!

Changes include:
* add encoding definition when loading themes json by FelipeAdachi in https://github.com/whylabs/langkit/pull/92
* LLM behavior monitoring example by FelipeAdachi in https://github.com/whylabs/langkit/pull/91
* Update whylogs dependency, update version to 0.0.7 by jamie256 in https://github.com/whylabs/langkit/pull/93

Read more about LangKit [here](https://github.com/whylabs/langkit/blob/main/DESCRIPTION.md)

Hi everyone! We’ve now released the first version of LangKit 0.0.6 🚀.

LangKit is an open-source text metrics toolkit for monitoring language models. It offers an array of methods for extracting relevant signals from the input and/or output text, which are compatible with the open-source data logging library [whylogs](https://whylogs.readthedocs.io/en/latest).

💡 Want to experience LangKit? Go to this [notebook](https://github.com/whylabs/langkit/blob/main/langkit/examples/Intro_to_Langkit.ipynb)!

Changes include:
* Update whylogs dependency to 1.2.3 jamie256 in https://github.com/whylabs/langkit/pull/88
* Update intro notebook install command
* Update version info to 0.0.6

Read more about LangKit [here](https://github.com/whylabs/langkit/blob/main/DESCRIPTION.md)