WhyLabs

LangKit

LangKit is an open-source toolkit that extracts telemetry from LLM prompts and responses including relevance, sentiment, toxicity, prompt injection signals, jailbreak similarity, refusal patterns, and quality metrics. Designed to plug into whylogs profiles for end-to-end LLM observability.

LangKit is one of 3 APIs that WhyLabs publishes on the APIs.io network.

Tagged areas include Open Source, LLM Monitoring, Telemetry, and Safety. The published artifact set on APIs.io includes SDKs.

GitHub

SDKs

📦
SDK
https://pypi.org/project/langkit/

Other Resources

🔗
SourceCode
https://github.com/whylabs/langkit

API entry from apis.yml

apis.yml Raw ↑ 
aid: whylabs:langkit
name: LangKit
tags:
- Open Source
- LLM Monitoring
- Telemetry
- Safety
humanURL: https://github.com/whylabs/langkit
properties:
- url: https://github.com/whylabs/langkit
  type: SourceCode
- url: https://pypi.org/project/langkit/
  type: SDK
description: LangKit is an open-source toolkit that extracts telemetry from LLM prompts and responses
  including relevance, sentiment, toxicity, prompt injection signals, jailbreak similarity, refusal patterns,
  and quality metrics. Designed to plug into whylogs profiles for end-to-end LLM observability.