WhyLabs

LangKit

LangKit is an open-source toolkit that extracts telemetry from LLM prompts and responses including relevance, sentiment, toxicity, prompt injection signals, jailbreak similarity, refusal patterns, and quality metrics. Designed to plug into whylogs profiles for end-to-end LLM observability.

Documentation GitHub

SDKs

📦

SDK

https://pypi.org/project/langkit/

Other Resources

🔗

SourceCode

https://github.com/whylabs/langkit

API entry from apis.yml

aid: whylabs:langkit
name: LangKit
tags:
- Open Source
- LLM Monitoring
- Telemetry
- Safety
humanURL: https://github.com/whylabs/langkit
properties:
- url: https://github.com/whylabs/langkit
  type: SourceCode
- url: https://pypi.org/project/langkit/
  type: SDK
description: LangKit is an open-source toolkit that extracts telemetry from LLM prompts and responses
  including relevance, sentiment, toxicity, prompt injection signals, jailbreak similarity, refusal patterns,
  and quality metrics. Designed to plug into whylogs profiles for end-to-end LLM observability.