Patronus AI

Patronus Evaluation API

The Patronus Evaluation API scores LLM outputs against built-in and custom evaluators covering hallucination, answer relevance, context utilization, safety, and PII. Evaluators can be invoked synchronously for guardrails, asynchronously for batch scoring, and as part of experiment runs that compare prompt and model variants over datasets.

GitHub

Documentation

📖
Documentation
https://docs.patronus.ai/docs
📖
APIReference
https://docs.patronus.ai/reference

API entry from apis.yml

apis.yml Raw ↑ 
aid: patronus-ai:patronus-evaluation-api
name: Patronus Evaluation API
tags:
- LLM Evaluation
- Judges
- API
- Scoring
humanURL: https://docs.patronus.ai/docs
properties:
- url: https://docs.patronus.ai/docs
  type: Documentation
- url: https://docs.patronus.ai/reference
  type: APIReference
description: The Patronus Evaluation API scores LLM outputs against built-in and custom evaluators covering
  hallucination, answer relevance, context utilization, safety, and PII. Evaluators can be invoked synchronously
  for guardrails, asynchronously for batch scoring, and as part of experiment runs that compare prompt
  and model variants over datasets.