by whylabs · Agent Tool · ★ 976
Last updated: · Indexed by AgentSkillsHub · Auto-synced every 8h
LangKit LangKit is an open-source text metrics toolkit for monitoring language models. It offers an array of methods for extracting relevant signals from the input and/or output text, which are compatible with the open-source data logging library whylogs. 💡 Want to experience LangKit? Go to this notebook! Table of Contents 📖 Motivation Features Installation Usage Modules Motivation 🎯 Productionizing language models, including LLMs, comes with a range of risks due to the infinite amount of input combinations, which can elicit an infinite amount of outputs. The unstructured nature of text poses a challenge in the ML observability space - a challenge worth solving, since the lack of visibility on the model's behavior can have serious consequences. Features 🛠️ The out of the box metrics include: Text Quality readability score complexity and grade scores Text Relevance Similarity scores between prompt/responses Similarity scores against user-defined themes [Security and Privacy](https://github.com/whylabs/la
| Stars | 976 |
| Forks | 71 |
| Language | Jupyter Notebook |
| Category | Agent Tool |
| License | Apache-2.0 |
| Quality Score | 43.3/100 |
| Open Issues | 36 |
| Last Updated | 2024-11-22 |
| Created | 2023-04-26 |
| Est. Tokens | ~351k |
Looking for a langkit alternative? If you're comparing langkit with other agent tool tools, these 6 projects are the closest alternatives on Agent Skills Hub — ranked by topic overlap, star count, and community traction.
🦙 Integrating LLMs into structured NLP pipelines
🌟 A curated collection of free, high quality AI tools 🤖, APIs 🔗, datasets 📊, and learning resources 📚 cov
Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and
Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning
An AI Gateway, registry, and proxy that sits in front of any MCP, A2A, or REST/gRPC APIs, exposing a unified e
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
Explore other popular agent tool tools:
langkit is 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance m. It is categorized as a Agent Tool with 976 GitHub stars.
langkit is primarily written in Jupyter Notebook. It covers topics such as large-language-models, machine-learning, nlg.
You can find installation instructions and usage details in the langkit GitHub repository at github.com/whylabs/langkit. The project has 976 stars and 71 forks, indicating an active community.
langkit is released under the Apache-2.0 license, making it free to use and modify according to the license terms.
The top alternatives to langkit on Agent Skills Hub include spacy-llm, free-ai-resources-x, prompttools. Each offers a different approach to the same problem space — compare them side-by-side by stars, quality score, and community activity.