AI Demos · Schema

RunFactHoldIn

The Reviewer accepted this submission while the researcher still owed the run facts it names (0117). Not an acceptance: the task is returned `in progress` with the fields named and nothing is recorded. Keyed by submission_sha256 like a deferral; it becomes one only when the run-fact completion delivers, records and approves.

Artificial IntelligenceBenchmarkingMachine LearningDataAnalytics

Properties

Name Type Description
benchmark_version_id string
subject_id string
scenario_id string
round integer
pinned_digest string
test_case_version_id string
clickup_task_id string
researcher_clickup_id string
reviewer_actor_id string
external_session_id string
proposal_sha256 string
researcher_proposed_verdict object
proposed_reviewed_verdict string
reviewed_at string
source_task_updated_at string
source_comment_cursor string
submission_sha256 string
run_facts_missing array
View JSON Schema on GitHub

JSON Schema

aidemos-com-run-fact-hold-in-schema.json Raw ↑
{
  "$schema": "https://json-schema.org/draft/2020-12/schema",
  "$id": "https://artifacts.apis.io/aidemos-com/json-schema/aidemos-com-run-fact-hold-in-schema.json",
  "title": "RunFactHoldIn",
  "description": "The Reviewer accepted this submission while the researcher still owed the run facts it names (0117).\n\nNot an acceptance: the task is returned `in progress` with the fields named and nothing is recorded. Keyed by\nsubmission_sha256 like a deferral; it becomes one only when the run-fact completion delivers, records and approves.",
  "x-generated": "2026-11-01",
  "x-method": "derived",
  "x-generator": "derive-json-schema.py",
  "x-source": "openapi/aidemos-com-openapi.json#/components/schemas/RunFactHoldIn",
  "properties": {
    "benchmark_version_id": {
      "type": "string",
      "title": "Benchmark Version Id"
    },
    "subject_id": {
      "type": "string",
      "title": "Subject Id"
    },
    "scenario_id": {
      "type": "string",
      "title": "Scenario Id"
    },
    "round": {
      "type": "integer",
      "minimum": 1.0,
      "title": "Round"
    },
    "pinned_digest": {
      "type": "string",
      "pattern": "^[a-f0-9]{64}$",
      "title": "Pinned Digest"
    },
    "test_case_version_id": {
      "type": "string",
      "title": "Test Case Version Id"
    },
    "clickup_task_id": {
      "type": "string",
      "title": "Clickup Task Id"
    },
    "researcher_clickup_id": {
      "type": "string",
      "title": "Researcher Clickup Id"
    },
    "reviewer_actor_id": {
      "type": "string",
      "title": "Reviewer Actor Id"
    },
    "external_session_id": {
      "type": "string",
      "title": "External Session Id"
    },
    "proposal_sha256": {
      "type": "string",
      "pattern": "^[a-f0-9]{64}$",
      "title": "Proposal Sha256"
    },
    "researcher_proposed_verdict": {
      "anyOf": [
        {
          "type": "string",
          "enum": [
            "pass",
            "fail",
            "not_gradable"
          ]
        },
        {
          "type": "null"
        }
      ],
      "title": "Researcher Proposed Verdict"
    },
    "proposed_reviewed_verdict": {
      "type": "string",
      "enum": [
        "pass",
        "fail",
        "not_gradable"
      ],
      "title": "Proposed Reviewed Verdict"
    },
    "reviewed_at": {
      "type": "string",
      "format": "date-time",
      "title": "Reviewed At"
    },
    "source_task_updated_at": {
      "type": "string",
      "title": "Source Task Updated At"
    },
    "source_comment_cursor": {
      "type": "string",
      "title": "Source Comment Cursor"
    },
    "submission_sha256": {
      "type": "string",
      "pattern": "^[a-f0-9]{64}$",
      "title": "Submission Sha256"
    },
    "run_facts_missing": {
      "items": {
        "type": "string"
      },
      "type": "array",
      "maxItems": 8,
      "minItems": 1,
      "title": "Run Facts Missing"
    }
  },
  "additionalProperties": false,
  "type": "object",
  "required": [
    "benchmark_version_id",
    "subject_id",
    "scenario_id",
    "round",
    "pinned_digest",
    "test_case_version_id",
    "clickup_task_id",
    "researcher_clickup_id",
    "reviewer_actor_id",
    "external_session_id",
    "proposal_sha256",
    "proposed_reviewed_verdict",
    "reviewed_at",
    "source_task_updated_at",
    "source_comment_cursor",
    "submission_sha256",
    "run_facts_missing"
  ]
}

Work with this as data

Every JSON Schema here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for schemas

4 MCP tools reach this
  • find_json_schemasBrowse and filter every JSON Schema in the catalog.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This JSON Schema
curl "https://apis.io/api/v1/json-schemas/aidemos-com-run-fact-hold-in"
All schemas
curl "https://apis.io/api/v1/json-schemas?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.