Rulebase

Rulebase Manual Qa Evaluation Submissions API

The Manual Qa Evaluation Submissions API from Rulebase — 4 operation(s) for manual qa evaluation submissions.

GitHub OpenAPI

Operations 4

GET /manual_qa_evaluation_submissions Get manual qa evaluation submissions #
PATCH /manual_qa_evaluation_submissions/{id} Update manual qa evaluation submissions by id #
POST /manual_qa_evaluation_submissions/{id}/approve Create manual qa evaluation submissions by id approve #
POST /manual_qa_evaluation_submissions/{id}/reject Create manual qa evaluation submissions by id reject #

Specifications

⚙
OpenAPI
https://artifacts.apis.io/rulebase/openapi/rulebase-manual-qa-evaluation-submissions-api-openapi.yml

Schemas & Data

📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-qa-agent-evaluation-scorecard-criterion-result-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-linked-activity-thread-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-scorecard-form-params-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-evaluation-schedule-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-practice-simulation-attempt-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-practice-simulation-dry-run-schema.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/rulebase:rulebase-manual-qa-evaluation-submissions-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

rulebase-manual-qa-evaluation-submissions-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Rulebase API2 Manual Qa Evaluation Submissions API
  version: 0.0.1
tags:
- name: Manual Qa Evaluation Submissions
paths:
  /manual_qa_evaluation_submissions:
    get:
      parameters:
      - schema:
          type: string
        required: false
        name: conversation_id
        in: query
      - schema:
          type: string
          enum:
          - pending
          - approved
          - rejected
        required: false
        name: status
        in: query
      - schema:
          type: string
          enum:
          - 'true'
        required: false
        name: feedback_for_current_user
        in: query
      - schema:
          type: integer
          minimum: 1
          maximum: 200
        required: false
        name: limit
        in: query
      responses:
        '200':
          description: Manual QA evaluation submissions visible to the member
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: array
                    items:
                      type: object
                      properties:
                        id:
                          type: string
                        status:
                          type: string
                          enum:
                          - pending
                          - approved
                          - rejected
                        conversation_id:
                          type: string
                        conversation_display_id:
                          type: string
                          nullable: true
                        conversation_subject:
                          type: string
                          nullable: true
                        evaluation_assignment_id:
                          type: string
                          nullable: true
                        source_qa_evaluation_id:
                          type: string
                          nullable: true
                        qa_evaluation_id:
                          type: string
                          nullable: true
                        overall_score:
                          type: number
                          nullable: true
                        reviewer_feedback:
                          type: string
                          nullable: true
                        check_reviewer_feedback:
                          type: array
                          nullable: true
                          items:
                            type: object
                            properties:
                              subject_employee_id:
                                type: string
                                nullable: true
                                minLength: 1
                              scorecard_criterion_check_id:
                                type: string
                                minLength: 1
                              feedback:
                                type: string
                                nullable: true
                                maxLength: 4000
                              was_corrected:
                                type: boolean
                            required:
                            - scorecard_criterion_check_id
                            - feedback
                            - was_corrected
                        published_qa_evaluation:
                          type: object
                          nullable: true
                          additionalProperties:
                            nullable: true
                        submitted_by:
                          type: object
                          nullable: true
                          properties:
                            id:
                              type: string
                            full_name:
                              type: string
                            email:
                              type: string
                          required:
                          - id
                          - full_name
                          - email
                        reviewed_by:
                          type: object
                          nullable: true
                          properties:
                            id:
                              type: string
                            full_name:
                              type: string
                            email:
                              type: string
                          required:
                          - id
                          - full_name
                          - email
                        submitted_at:
                          type: string
                        reviewed_at:
                          type: string
                          nullable: true
                        qa_evaluation:
                          type: object
                          additionalProperties:
                            nullable: true
                      required:
                      - id
                      - status
                      - conversation_id
                      - conversation_display_id
                      - conversation_subject
                      - evaluation_assignment_id
                      - source_qa_evaluation_id
                      - qa_evaluation_id
                      - overall_score
                      - reviewer_feedback
                      - check_reviewer_feedback
                      - published_qa_evaluation
                      - submitted_by
                      - reviewed_by
                      - submitted_at
                      - reviewed_at
                      - qa_evaluation
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Organization not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Manual Qa Evaluation Submissions
      summary: Get manual qa evaluation submissions
      x-summary-source: derived
      operationId: getManualQaEvaluationSubmissions
      x-operation-id-source: derived
  /manual_qa_evaluation_submissions/{id}:
    patch:
      parameters:
      - schema:
          type: string
          minLength: 1
        required: true
        name: id
        in: path
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              properties:
                qa_evaluation:
                  type: object
                  properties:
                    qa_evaluation_id:
                      type: string
                    evaluation_assignment_id:
                      type: string
                    agent_evaluations:
                      type: array
                      items:
                        nullable: true
                      minItems: 1
                  required:
                  - agent_evaluations
              required:
              - qa_evaluation
      responses:
        '200':
          description: Manual QA evaluation submission updated
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      id:
                        type: string
                      status:
                        type: string
                        enum:
                        - pending
                        - approved
                        - rejected
                      conversation_id:
                        type: string
                      conversation_display_id:
                        type: string
                        nullable: true
                      conversation_subject:
                        type: string
                        nullable: true
                      evaluation_assignment_id:
                        type: string
                        nullable: true
                      source_qa_evaluation_id:
                        type: string
                        nullable: true
                      qa_evaluation_id:
                        type: string
                        nullable: true
                      overall_score:
                        type: number
                        nullable: true
                      reviewer_feedback:
                        type: string
                        nullable: true
                      check_reviewer_feedback:
                        type: array
                        nullable: true
                        items:
                          type: object
                          properties:
                            subject_employee_id:
                              type: string
                              nullable: true
                              minLength: 1
                            scorecard_criterion_check_id:
                              type: string
                              minLength: 1
                            feedback:
                              type: string
                              nullable: true
                              maxLength: 4000
                            was_corrected:
                              type: boolean
                          required:
                          - scorecard_criterion_check_id
                          - feedback
                          - was_corrected
                      published_qa_evaluation:
                        type: object
                        nullable: true
                        additionalProperties:
                          nullable: true
                      submitted_by:
                        type: object
                        nullable: true
                        properties:
                          id:
                            type: string
                          full_name:
                            type: string
                          email:
                            type: string
                        required:
                        - id
                        - full_name
                        - email
                      reviewed_by:
                        type: object
                        nullable: true
                        properties:
                          id:
                            type: string
                          full_name:
                            type: string
                          email:
                            type: string
                        required:
                        - id
                        - full_name
                        - email
                      submitted_at:
                        type: string
                      reviewed_at:
                        type: string
                        nullable: true
                      qa_evaluation:
                        type: object
                        additionalProperties:
                          nullable: true
                    required:
                    - id
                    - status
                    - conversation_id
                    - conversation_display_id
                    - conversation_subject
                    - evaluation_assignment_id
                    - source_qa_evaluation_id
                    - qa_evaluation_id
                    - overall_score
                    - reviewer_feedback
                    - check_reviewer_feedback
                    - published_qa_evaluation
                    - submitted_by
                    - reviewed_by
                    - submitted_at
                    - reviewed_at
                    - qa_evaluation
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Submission not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '422':
          description: Submission could not be updated
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Manual Qa Evaluation Submissions
      summary: Update manual qa evaluation submissions by id
      x-summary-source: derived
      operationId: patchManualQaEvaluationSubmissionsById
      x-operation-id-source: derived
  /manual_qa_evaluation_submissions/{id}/approve:
    post:
      parameters:
      - schema:
          type: string
          minLength: 1
        required: true
        name: id
        in: path
      requestBody:
        required: false
        content:
          application/json:
            schema:
              type: object
              properties:
                reviewer_feedback:
                  type: string
                  nullable: true
                  maxLength: 4000
                qa_evaluation:
                  type: object
                  properties:
                    qa_evaluation_id:
                      type: string
                    evaluation_assignment_id:
                      type: string
                    agent_evaluations:
                      type: array
                      items:
                        nullable: true
                      minItems: 1
                  required:
                  - agent_evaluations
                check_reviewer_feedback:
                  type: array
                  items:
                    type: object
                    properties:
                      subject_employee_id:
                        type: string
                        minLength: 1
                      scorecard_criterion_check_id:
                        type: string
                        minLength: 1
                      feedback:
                        type: string
                        nullable: true
                        maxLength: 4000
                    required:
                    - subject_employee_id
                    - scorecard_criterion_check_id
      responses:
        '200':
          description: Manual QA evaluation submission approved
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      id:
                        type: string
                      status:
                        type: string
                        enum:
                        - pending
                        - approved
                        - rejected
                      conversation_id:
                        type: string
                      conversation_display_id:
                        type: string
                        nullable: true
                      conversation_subject:
                        type: string
                        nullable: true
                      evaluation_assignment_id:
                        type: string
                        nullable: true
                      source_qa_evaluation_id:
                        type: string
                        nullable: true
                      qa_evaluation_id:
                        type: string
                        nullable: true
                      overall_score:
                        type: number
                        nullable: true
                      reviewer_feedback:
                        type: string
                        nullable: true
                      check_reviewer_feedback:
                        type: array
                        nullable: true
                        items:
                          type: object
                          properties:
                            subject_employee_id:
                              type: string
                              nullable: true
                              minLength: 1
                            scorecard_criterion_check_id:
                              type: string
                              minLength: 1
                            feedback:
                              type: string
                              nullable: true
                              maxLength: 4000
                            was_corrected:
                              type: boolean
                          required:
                          - scorecard_criterion_check_id
                          - feedback
                          - was_corrected
                      published_qa_evaluation:
                        type: object
                        nullable: true
                        additionalProperties:
                          nullable: true
                      submitted_by:
                        type: object
                        nullable: true
                        properties:
                          id:
                            type: string
                          full_name:
                            type: string
                          email:
                            type: string
                        required:
                        - id
                        - full_name
                        - email
                      reviewed_by:
                        type: object
                        nullable: true
                        properties:
                          id:
                            type: string
                          full_name:
                            type: string
                          email:
                            type: string
                        required:
                        - id
                        - full_name
                        - email
                      submitted_at:
                        type: string
                      reviewed_at:
                        type: string
                        nullable: true
                      qa_evaluation:
                        type: object
                        additionalProperties:
                          nullable: true
                    required:
                    - id
                    - status
                    - conversation_id
                    - conversation_display_id
                    - conversation_subject
                    - evaluation_assignment_id
                    - source_qa_evaluation_id
                    - qa_evaluation_id
                    - overall_score
                    - reviewer_feedback
                    - check_reviewer_feedback
                    - published_qa_evaluation
                    - submitted_by
                    - reviewed_by
                    - submitted_at
                    - reviewed_at
                    - qa_evaluation
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Submission not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '422':
          description: Submission could not be approved
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Manual Qa Evaluation Submissions
      summary: Create manual qa evaluation submissions by id approve
      x-summary-source: derived
      operationId: postManualQaEvaluationSubmissionsByIdApprove
      x-operation-id-source: derived
  /manual_qa_evaluation_submissions/{id}/reject:
    post:
      parameters:
      - schema:
          type: string
          minLength: 1
        required: true
        name: id
        in: path
      requestBody:
        required: false
        content:
          application/json:
            schema:
              type: object
              properties:
                reviewer_feedback:
                  type: string
                  nullable: true
                  maxLength: 4000
                qa_evaluation:
                  type: object
                  properties:
                    qa_evaluation_id:
                      type: string
                    evaluation_assignment_id:
                      type: string
                    agent_evaluations:
                      type: array
                      items:
                        nullable: true
                      minItems: 1
                  required:
                  - agent_evaluations
                check_reviewer_feedback:
                  type: array
                  items:
                    type: object
                    properties:
                      subject_employee_id:
                        type: string
                        minLength: 1
                      scorecard_criterion_check_id:
                        type: string
                        minLength: 1
                      feedback:
                        type: string
                        nullable: true
                        maxLength: 4000
                    required:
                    - subject_employee_id
                    - scorecard_criterion_check_id
      responses:
        '200':
          description: Manual QA evaluation submission rejected
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      id:
                        type: string
                      status:
                        type: string
                        enum:
                        - pending
                        - approved
                        - rejected
                      conversation_id:
                        type: string
                      conversation_display_id:
                        type: string
                        nullable: true
                      conversation_subject:
                        type: string
                        nullable: true
                      evaluation_assignment_id:
                        type: string
                        nullable: true
                      source_qa_evaluation_id:
                        type: string
                        nullable: true
                      qa_evaluation_id:
                        type: string
                        nullable: true
                      overall_score:
                        type: number
                        nullable: true
                      reviewer_feedback:
                        type: string
                        nullable: true
                      check_reviewer_feedback:
                        type: array
                        nullable: true
                        items:
                          type: object
                          properties:
                            subject_employee_id:
                              type: string
                              nullable: true
                              minLength: 1
                            scorecard_criterion_check_id:
                              type: string
                              minLength: 1
                            feedback:
                              type: string
                              nullable: true
                              maxLength: 4000
                            was_corrected:
                              type: boolean
                          required:
                          - scorecard_criterion_check_id
                          - feedback
                          - was_corrected
                      published_qa_evaluation:
                        type: object
                        nullable: true
                        additionalProperties:
                          nullable: true
                      submitted_by:
                        type: object
                        nullable: true
                        properties:
                          id:
                            type: string
                          full_name:
                            type: string
                          email:
                            type: string
                        required:
                        - id
                        - full_name
                        - email
                      reviewed_by:
                        type: object
                        nullable: true
                        properties:
                          id:
                            type: string
                          full_name:
                            type: string
                          email:
                            type: string
                        required:
                        - id
                        - full_name
                        - email
                      submitted_at:
                        type: string
                      reviewed_at:
                        type: string
                        nullable: true
                      qa_evaluation:
                        type: object
                        additionalProperties:
                          nullable: true
                    required:
                    - id
                    - status
                    - conversation_id
                    - conversation_display_id
                    - conversation_subject
                    - evaluation_assignment_id
                    - source_qa_evaluation_id
                    - qa_evaluation_id
                    - overall_score
                    - reviewer_feedback
                    - check_reviewer_feedback
                    - published_qa_evaluation
                    - submitted_by
                    - reviewed_by
                    - submitted_at
                    - reviewed_at
                    - qa_evaluation
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Submission not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '422':
          description: Submission could not be rejected
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Manual Qa Evaluation Submissions
      summary: Create manual qa evaluation submissions by id reject
      x-summary-source: derived
      operationId: postManualQaEvaluationSubmissionsByIdReject
      x-operation-id-source: derived
components:
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      description: Rulebase organization API key