forecall-dev · Schema

StartedEvaluation

Static LinterDescription ScoringFailure Records

Properties

Name Type Description
id string
name string
status string
server object
version object
cases integer The cases: reused, or planned
casesReused boolean
settings object
units integer All the units the evaluation takes
casegen object
models array
warnings array
runs array
View JSON Schema on GitHub

JSON Schema

forecall-dev-started-evaluation-schema.json Raw ↑
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://artifacts.apis.io/forecall-dev/json-schema/forecall-dev-started-evaluation-schema.json",
  "title": "StartedEvaluation",
  "x-generated": "2026-11-08",
  "x-method": "derived",
  "x-generator": "derive-json-schema.py",
  "x-source": "openapi/forecall-dev-openapi.json#/components/schemas/StartedEvaluation",
  "type": "object",
  "properties": {
    "id": {
      "type": "string",
      "format": "uuid"
    },
    "name": {
      "type": "string"
    },
    "status": {
      "type": "string",
      "enum": [
        "queued"
      ]
    },
    "server": {
      "type": "object",
      "properties": {
        "id": {
          "type": "string",
          "format": "uuid"
        },
        "slug": {
          "type": "string"
        },
        "name": {
          "type": "string"
        }
      },
      "required": [
        "id",
        "slug",
        "name"
      ]
    },
    "version": {
      "type": "object",
      "properties": {
        "id": {
          "type": "string",
          "format": "uuid"
        },
        "label": {
          "type": [
            "string",
            "null"
          ]
        }
      },
      "required": [
        "id",
        "label"
      ]
    },
    "cases": {
      "type": "integer",
      "description": "The cases: reused, or planned"
    },
    "casesReused": {
      "type": "boolean"
    },
    "settings": {
      "$ref": "#/$defs/EvaluationSettings"
    },
    "units": {
      "type": "integer",
      "description": "All the units the evaluation takes"
    },
    "casegen": {
      "type": "object",
      "properties": {
        "calls": {
          "type": "integer"
        },
        "units": {
          "type": "integer"
        }
      },
      "required": [
        "calls",
        "units"
      ]
    },
    "models": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "model": {
            "type": "string"
          },
          "calls": {
            "type": "integer"
          },
          "reused": {
            "type": "integer",
            "description": "Cases whose result is reused"
          },
          "units": {
            "type": "integer"
          }
        },
        "required": [
          "model",
          "calls",
          "reused",
          "units"
        ]
      }
    },
    "warnings": {
      "type": "array",
      "items": {
        "type": "object"
      }
    },
    "runs": {
      "type": "array",
      "items": {
        "type": "object",
        "properties": {
          "id": {
            "type": "string",
            "format": "uuid"
          },
          "model": {
            "type": "string"
          },
          "units": {
            "type": "integer",
            "description": "The units taken for the run: the first's include writing the cases"
          }
        },
        "required": [
          "id",
          "model",
          "units"
        ]
      }
    }
  },
  "required": [
    "id",
    "name",
    "status",
    "server",
    "version",
    "cases",
    "casesReused",
    "settings",
    "units",
    "casegen",
    "models",
    "warnings",
    "runs"
  ],
  "$defs": {
    "EvaluationSettings": {
      "type": "object",
      "properties": {
        "casesPerTool": {
          "type": "integer",
          "description": "Positive cases per tool: 8 on Pro, 20 on Team"
        },
        "lang": {
          "type": "string",
          "enum": [
            "en",
            "ja"
          ]
        },
        "distractors": {
          "type": "array",
          "items": {
            "type": "string"
          }
        }
      },
      "required": [
        "casesPerTool",
        "lang",
        "distractors"
      ]
    }
  }
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this
  • find_json_schemasBrowse and filter every JSON Schema in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/forecall-dev-started-evaluation"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.