Rulebase

Rulebase Qa Re Evaluation Runs API

The Qa Re Evaluation Runs API from Rulebase — 5 operation(s) for qa re evaluation runs.

GitHub OpenAPI

Operations 6

GET /qa_re_evaluation_runs/criteria Get qa re evaluation runs criteria #
POST /qa_re_evaluation_runs/preview Create qa re evaluation runs preview #
POST /qa_re_evaluation_runs Create qa re evaluation runs #
GET /qa_re_evaluation_runs Get qa re evaluation runs #
GET /qa_re_evaluation_runs/{id} Get qa re evaluation runs by id #
POST /qa_re_evaluation_runs/{id}/retry Create qa re evaluation runs by id retry #

Specifications

⚙
OpenAPI
https://artifacts.apis.io/rulebase/openapi/rulebase-qa-re-evaluation-runs-api-openapi.yml

Schemas & Data

📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-qa-agent-evaluation-scorecard-criterion-result-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-linked-activity-thread-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-scorecard-form-params-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-evaluation-schedule-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-practice-simulation-attempt-schema.json
📊
JSONSchema
https://artifacts.apis.io/rulebase/json-schema/rulebase-practice-simulation-dry-run-schema.json

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/rulebase:rulebase-qa-re-evaluation-runs-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

rulebase-qa-re-evaluation-runs-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Rulebase API2 Qa Re Evaluation Runs API
  version: 0.0.1
tags:
- name: Qa Re Evaluation Runs
paths:
  /qa_re_evaluation_runs/criteria:
    get:
      responses:
        '200':
          description: Scorecard criteria available for re-evaluation
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      scorecards:
                        type: array
                        items:
                          type: object
                          properties:
                            scorecard_id:
                              type: string
                            scorecard_name:
                              type: string
                              nullable: true
                            criteria:
                              type: array
                              items:
                                type: object
                                properties:
                                  id:
                                    type: string
                                  name:
                                    type: string
                                    nullable: true
                                  has_auto_fail:
                                    type: boolean
                                  has_fail:
                                    type: boolean
                                  has_partial:
                                    type: boolean
                                required:
                                - id
                                - name
                                - has_auto_fail
                                - has_fail
                                - has_partial
                          required:
                          - scorecard_id
                          - scorecard_name
                          - criteria
                    required:
                    - scorecards
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Organization not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Qa Re Evaluation Runs
      summary: Get qa re evaluation runs criteria
      x-summary-source: derived
      operationId: getQaReEvaluationRunsCriteria
      x-operation-id-source: derived
  /qa_re_evaluation_runs/preview:
    post:
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              properties:
                selection_mode:
                  type: string
                  enum:
                  - conditions
                  - tickets
                  default: conditions
                evaluated_after:
                  type: string
                  format: date-time
                evaluated_before:
                  type: string
                  format: date-time
                condition_type:
                  type: string
                  enum:
                  - auto_failed_criteria
                  - failed_criteria
                  - partial_criteria
                  default: auto_failed_criteria
                condition_criterion_ids:
                  type: array
                  items:
                    type: string
                  maxItems: 100
                  default: []
                conversation_ids:
                  type: array
                  items:
                    type: string
                  maxItems: 500
                  default: []
                target_criterion_ids:
                  type: array
                  items:
                    type: string
                  maxItems: 100
              required:
              - target_criterion_ids
      responses:
        '200':
          description: Preview
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      matching_evaluations:
                        type: integer
                      matching_tickets:
                        type: integer
                      re_evaluable_evaluations:
                        type: integer
                      by_scorecard:
                        type: array
                        items:
                          type: object
                          properties:
                            scorecard_id:
                              type: string
                            scorecard_name:
                              type: string
                              nullable: true
                            evaluations:
                              type: integer
                          required:
                          - scorecard_id
                          - scorecard_name
                          - evaluations
                      sample:
                        type: array
                        items:
                          type: object
                          properties:
                            qa_agent_evaluation_id:
                              type: string
                            conversation_prefix_id:
                              type: string
                              nullable: true
                            conversation_external_id:
                              type: string
                              nullable: true
                            subject_employee_name:
                              type: string
                              nullable: true
                            criteria:
                              type: array
                              items:
                                type: object
                                properties:
                                  criterion_id:
                                    type: string
                                  score_option_label:
                                    type: string
                                    nullable: true
                                  score:
                                    type: number
                                    nullable: true
                                required:
                                - criterion_id
                                - score_option_label
                                - score
                          required:
                          - qa_agent_evaluation_id
                          - conversation_prefix_id
                          - conversation_external_id
                          - subject_employee_name
                          - criteria
                    required:
                    - matching_evaluations
                    - matching_tickets
                    - re_evaluable_evaluations
                    - by_scorecard
                    - sample
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Organization not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '422':
          description: Invalid selection
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Qa Re Evaluation Runs
      summary: Create qa re evaluation runs preview
      x-summary-source: derived
      operationId: postQaReEvaluationRunsPreview
      x-operation-id-source: derived
  /qa_re_evaluation_runs:
    post:
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              properties:
                selection_mode:
                  type: string
                  enum:
                  - conditions
                  - tickets
                  default: conditions
                evaluated_after:
                  type: string
                  format: date-time
                evaluated_before:
                  type: string
                  format: date-time
                condition_type:
                  type: string
                  enum:
                  - auto_failed_criteria
                  - failed_criteria
                  - partial_criteria
                  default: auto_failed_criteria
                condition_criterion_ids:
                  type: array
                  items:
                    type: string
                  maxItems: 100
                  default: []
                conversation_ids:
                  type: array
                  items:
                    type: string
                  maxItems: 500
                  default: []
                target_criterion_ids:
                  type: array
                  items:
                    type: string
                  minItems: 1
                  maxItems: 100
                confirm:
                  type: boolean
              required:
              - target_criterion_ids
      responses:
        '201':
          description: Run created
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      id:
                        type: string
                      total_items:
                        type: integer
                    required:
                    - id
                    - total_items
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Organization not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '409':
          description: Confirmation required
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                  re_evaluable_evaluations:
                    type: integer
                required:
                - error
                - re_evaluable_evaluations
        '422':
          description: Invalid selection
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Qa Re Evaluation Runs
      summary: Create qa re evaluation runs
      x-summary-source: derived
      operationId: postQaReEvaluationRuns
      x-operation-id-source: derived
    get:
      parameters:
      - schema:
          type: integer
          minimum: 1
          maximum: 50
        required: false
        name: limit
        in: query
      responses:
        '200':
          description: Runs
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      runs:
                        type: array
                        items:
                          type: object
                          properties:
                            id:
                              type: string
                            status:
                              type: string
                            selection_mode:
                              type: string
                            condition_type:
                              type: string
                            condition_criterion_ids:
                              type: array
                              items:
                                type: string
                            target_criterion_ids:
                              type: array
                              items:
                                type: string
                            conversation_ids:
                              type: array
                              items:
                                type: string
                            evaluated_after:
                              type: string
                              nullable: true
                            evaluated_before:
                              type: string
                              nullable: true
                            total_items:
                              type: integer
                            completed_items:
                              type: integer
                            failed_items:
                              type: integer
                            error_message:
                              type: string
                              nullable: true
                            created_at:
                              type: string
                            updated_at:
                              type: string
                            completed_at:
                              type: string
                              nullable: true
                          required:
                          - id
                          - status
                          - selection_mode
                          - condition_type
                          - condition_criterion_ids
                          - target_criterion_ids
                          - conversation_ids
                          - evaluated_after
                          - evaluated_before
                          - total_items
                          - completed_items
                          - failed_items
                          - error_message
                          - created_at
                          - updated_at
                          - completed_at
                    required:
                    - runs
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Qa Re Evaluation Runs
      summary: Get qa re evaluation runs
      x-summary-source: derived
      operationId: getQaReEvaluationRuns
      x-operation-id-source: derived
  /qa_re_evaluation_runs/{id}:
    get:
      parameters:
      - schema:
          type: string
        required: true
        name: id
        in: path
      responses:
        '200':
          description: Run detail
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      id:
                        type: string
                      status:
                        type: string
                      selection_mode:
                        type: string
                      condition_type:
                        type: string
                      condition_criterion_ids:
                        type: array
                        items:
                          type: string
                      target_criterion_ids:
                        type: array
                        items:
                          type: string
                      conversation_ids:
                        type: array
                        items:
                          type: string
                      evaluated_after:
                        type: string
                        nullable: true
                      evaluated_before:
                        type: string
                        nullable: true
                      total_items:
                        type: integer
                      completed_items:
                        type: integer
                      failed_items:
                        type: integer
                      error_message:
                        type: string
                        nullable: true
                      created_at:
                        type: string
                      updated_at:
                        type: string
                      completed_at:
                        type: string
                        nullable: true
                      items:
                        type: array
                        items:
                          type: object
                          properties:
                            id:
                              type: string
                            status:
                              type: string
                            conversation_prefix_id:
                              type: string
                              nullable: true
                            conversation_external_id:
                              type: string
                              nullable: true
                            qa_agent_evaluation_prefix_id:
                              type: string
                              nullable: true
                            subject_employee_name:
                              type: string
                              nullable: true
                            previous_overall_score:
                              type: number
                              nullable: true
                            new_overall_score:
                              type: number
                              nullable: true
                            error_message:
                              type: string
                              nullable: true
                            criteria:
                              type: array
                              items:
                                type: object
                                properties:
                                  id:
                                    type: string
                                  source_scorecard_criterion_id:
                                    type: string
                                  criterion_name:
                                    type: string
                                    nullable: true
                                  previous_score_option_label:
                                    type: string
                                    nullable: true
                                  new_score_option_label:
                                    type: string
                                    nullable: true
                                  previous_criterion_score:
                                    type: number
                                    nullable: true
                                  new_criterion_score:
                                    type: number
                                    nullable: true
                                required:
                                - id
                                - source_scorecard_criterion_id
                                - criterion_name
                                - previous_score_option_label
                                - new_score_option_label
                                - previous_criterion_score
                                - new_criterion_score
                          required:
                          - id
                          - status
                          - conversation_prefix_id
                          - conversation_external_id
                          - qa_agent_evaluation_prefix_id
                          - subject_employee_name
                          - previous_overall_score
                          - new_overall_score
                          - error_message
                          - criteria
                    required:
                    - id
                    - status
                    - selection_mode
                    - condition_type
                    - condition_criterion_ids
                    - target_criterion_ids
                    - conversation_ids
                    - evaluated_after
                    - evaluated_before
                    - total_items
                    - completed_items
                    - failed_items
                    - error_message
                    - created_at
                    - updated_at
                    - completed_at
                    - items
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Qa Re Evaluation Runs
      summary: Get qa re evaluation runs by id
      x-summary-source: derived
      operationId: getQaReEvaluationRunsById
      x-operation-id-source: derived
  /qa_re_evaluation_runs/{id}/retry:
    post:
      parameters:
      - schema:
          type: string
        required: true
        name: id
        in: path
      responses:
        '200':
          description: Retried
          content:
            application/json:
              schema:
                type: object
                properties:
                  data:
                    type: object
                    properties:
                      retried:
                        type: integer
                    required:
                    - retried
                required:
                - data
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
        '404':
          description: Not found
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: string
                required:
                - error
      tags:
      - Qa Re Evaluation Runs
      summary: Create qa re evaluation runs by id retry
      x-summary-source: derived
      operationId: postQaReEvaluationRunsByIdRetry
      x-operation-id-source: derived
components:
  securitySchemes:
    bearerAuth:
      type: http
      scheme: bearer
      description: Rulebase organization API key