Rulebase

Rulebase Manual QA evaluations API

The Manual QA evaluations API from Rulebase — 2 operation(s) for manual qa evaluations.

GitHub OpenAPI

Operations 2

POST /conversations/{conversation_id}/manual_qa_evaluations Create a manual QA evaluation for a conversation #
PATCH /manual_qa_evaluations/{id} Update a manual QA evaluation #

Specifications

⚙
OpenAPI
https://artifacts.apis.io/rulebase/openapi/rulebase-manual-qa-evaluations-api-openapi.yml

Schemas & Data

📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-qa-agent-evaluation-scorecard-criterion-result-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-linked-activity-thread-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-scorecard-form-params-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-evaluation-schedule-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-practice-simulation-attempt-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-practice-simulation-dry-run-schema.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/rulebase:rulebase-manual-qa-evaluations-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

rulebase-manual-qa-evaluations-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Rulebase API2 Manual QA evaluations API
  version: 0.0.1
tags:
- name: Manual QA evaluations
paths:
  /conversations/{conversation_id}/manual_qa_evaluations:
    post:
      summary: Create a manual QA evaluation for a conversation
      tags:
      - Manual QA evaluations
      parameters:
      - schema:
          type: string
        required: true
        name: conversation_id
        in: path
      requestBody:
        content:
          application/json:
            schema:
              type: object
              properties:
                qa_evaluation:
                  type: object
                  properties:
                    qa_evaluation_id:
                      type: string
                    evaluation_assignment_id:
                      type: string
                      nullable: true
                    agent_evaluations:
                      type: array
                      items:
                        nullable: true
                      minItems: 1
                    file_signed_ids:
                      type: array
                      items:
                        type: string
                  required:
                  - agent_evaluations
              required:
              - qa_evaluation
      responses:
        '201':
          description: Manual QA evaluation created
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      id:
                        type: string
                      conversation_id:
                        type: string
                      evaluation_assignment_id:
                        type: string
                        nullable: true
                      evaluation_assignment_status:
                        type: string
                        nullable: true
                        enum:
                        - pending
                        - in_progress
                        - completed
                      overall_score:
                        type: number
                        nullable: true
                      qa_agent_evaluation_ids:
                        type: array
                        items:
                          type: string
                    required:
                    - id
                    - conversation_id
                    - evaluation_assignment_id
                    - evaluation_assignment_status
                    - overall_score
                    - qa_agent_evaluation_ids
                required:
                - data
        '400':
          description: Malformed request
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '422':
          description: Evaluation could not be saved
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      operationId: postConversationsByConversationIdManualQaEvaluations
      x-operation-id-source: derived
  /manual_qa_evaluations/{id}:
    patch:
      summary: Update a manual QA evaluation
      tags:
      - Manual QA evaluations
      parameters:
      - schema:
          type: string
        required: true
        name: id
        in: path
      requestBody:
        content:
          application/json:
            schema:
              type: object
              properties:
                qa_evaluation:
                  type: object
                  properties:
                    qa_evaluation_id:
                      type: string
                    evaluation_assignment_id:
                      type: string
                      nullable: true
                    agent_evaluations:
                      type: array
                      items:
                        nullable: true
                      minItems: 1
                    file_signed_ids:
                      type: array
                      items:
                        type: string
                  required:
                  - agent_evaluations
              required:
              - qa_evaluation
      responses:
        '200':
          description: Manual QA evaluation updated
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      id:
                        type: string
                      conversation_id:
                        type: string
                      evaluation_assignment_id:
                        type: string
                        nullable: true
                      evaluation_assignment_status:
                        type: string
                        nullable: true
                        enum:
                        - pending
                        - in_progress
                        - completed
                      overall_score:
                        type: number
                        nullable: true
                      qa_agent_evaluation_ids:
                        type: array
                        items:
                          type: string
                    required:
                    - id
                    - conversation_id
                    - evaluation_assignment_id
                    - evaluation_assignment_status
                    - overall_score
                    - qa_agent_evaluation_ids
                required:
                - data
        '400':
          description: Malformed request
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '422':
          description: Evaluation could not be saved
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      operationId: patchManualQaEvaluationsById
      x-operation-id-source: derived
components:
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      description: Rulebase organization API key