Vapi · Schema
ChatEvalToolResponseMessageEvaluation
Artificial IntelligenceVoiceAgentsReal-TimeCPaaS
Properties
| Name | Type | Description |
|---|---|---|
| role | string | This is the role of the message author. For a tool response message evaluation, the role is always 'tool' @default 'tool' |
| judgePlan | object | This is the judge plan that instructs how to evaluate the tool response message. The tool response message can be evaluated with an LLM-as-judge by defining the evaluation criteria in a prompt. |
JSON Schema
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"$id": "#/components/schemas/ChatEvalToolResponseMessageEvaluation",
"title": "ChatEvalToolResponseMessageEvaluation",
"type": "object",
"properties": {
"role": {
"type": "string",
"enum": [
"tool"
],
"description": "This is the role of the message author.\nFor a tool response message evaluation, the role is always 'tool'\n@default 'tool'",
"default": "tool"
},
"judgePlan": {
"description": "This is the judge plan that instructs how to evaluate the tool response message.\nThe tool response message can be evaluated with an LLM-as-judge by defining the evaluation criteria in a prompt.",
"oneOf": [
{
"$ref": "#/components/schemas/AssistantMessageJudgePlanAI",
"title": "AssistantMessageJudgePlanAI"
}
],
"allOf": [
{
"$ref": "#/components/schemas/AssistantMessageJudgePlanAI"
}
]
}
},
"required": [
"role",
"judgePlan"
]
}
Work with this as data
Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for schemas
4 MCP tools reach this
find_json_schemasBrowse and filter every JSON Schema in the catalog.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/vapi-chatevaltoolresponsemessageevaluation"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"
Discovery needs no key. Ratings and market analysis are Pro.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.