OpenRelay

OpenRelay Clusters API

Autoscaling inference clusters that serve a container image behind an endpoint.

GitHub OpenAPI

Operations 8

GET /v1/clusters/{id} Get a cluster by id #
GET /v1/clusters/{id}/detail Get a cluster with its replicas and GPU model #
POST /v1/clusters/{id}/restart Restart a cluster #
POST /v1/clusters/{id}/scale Scale a cluster's replica count #
POST /v1/clusters/{id}/stop Stop a cluster #
POST /v1/clusters/{id}/terminate Terminate a cluster #
GET /v1/orgs/{orgId}/clusters List an org's clusters (cursor-paginated) #
POST /v1/orgs/{orgId}/clusters/create Create a cluster #

Documentation

📖
Documentation
https://docs.openrelay.inc
📖
APIReference
https://docs.openrelay.inc/docs/account/overview

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/openrelay/refs/heads/main/openapi/openrelay-clusters-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/openrelay-clusters-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openrelay-clusters-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  description: 'The OpenRelay control-plane REST API. Deploy GPU VMs and inference clusters, manage organizations and billing, and automate your infrastructure. All requests are authenticated with an API key (`vl_…`) unless noted otherwise.

    '
  title: OpenRelay Account Clusters API
  version: 0.1.0
servers:
- description: Production
  url: https://api.openrelay.inc
- description: Beta
  url: https://api.beta.openrelay.inc
- description: Local development
  url: http://localhost:8083
tags:
- description: Autoscaling inference clusters that serve a container image behind an endpoint.
  name: Clusters
paths:
  /v1/clusters/{id}:
    get:
      operationId: getCluster
      parameters:
      - in: path
        name: id
        required: true
        schema:
          type: string
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterSummary'
          description: The cluster
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
      security:
      - apiKey: []
      summary: Get a cluster by id
      tags:
      - Clusters
  /v1/clusters/{id}/detail:
    get:
      operationId: getClusterDetail
      parameters:
      - in: path
        name: id
        required: true
        schema:
          type: string
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterDetail'
          description: The cluster detail
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
      security:
      - apiKey: []
      summary: Get a cluster with its replicas and GPU model
      tags:
      - Clusters
      x-openrelay-mcp:
        default: true
  /v1/clusters/{id}/restart:
    post:
      operationId: restartCluster
      parameters:
      - in: path
        name: id
        required: true
        schema:
          type: string
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterSummary'
          description: OK
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
      security:
      - apiKey: []
      summary: Restart a cluster
      tags:
      - Clusters
  /v1/clusters/{id}/scale:
    post:
      operationId: scaleCluster
      parameters:
      - in: path
        name: id
        required: true
        schema:
          type: string
      requestBody:
        content:
          application/json:
            example:
              replicaCount: 4
            schema:
              $ref: '#/components/schemas/ScaleRequest'
        required: true
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterSummary'
          description: OK
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
        '409':
          $ref: '#/components/responses/Conflict'
      security:
      - apiKey: []
      summary: Scale a cluster's replica count
      tags:
      - Clusters
  /v1/clusters/{id}/stop:
    post:
      operationId: stopCluster
      parameters:
      - in: path
        name: id
        required: true
        schema:
          type: string
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterSummary'
          description: OK
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
      security:
      - apiKey: []
      summary: Stop a cluster
      tags:
      - Clusters
  /v1/clusters/{id}/terminate:
    post:
      operationId: terminateCluster
      parameters:
      - in: path
        name: id
        required: true
        schema:
          type: string
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterSummary'
          description: OK
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '404':
          $ref: '#/components/responses/NotFound'
      security:
      - apiKey: []
      summary: Terminate a cluster
      tags:
      - Clusters
      x-openrelay-mcp:
        destructiveHint: true
  /v1/orgs/{orgId}/clusters:
    get:
      operationId: listOrgClusters
      parameters:
      - in: path
        name: orgId
        required: true
        schema:
          type: string
      - in: query
        name: limit
        required: false
        schema:
          type: integer
      - in: query
        name: cursor
        required: false
        schema:
          type: string
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterPage'
          description: Page of clusters
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
      security:
      - apiKey: []
      summary: List an org's clusters (cursor-paginated)
      tags:
      - Clusters
      x-openrelay-mcp:
        default: true
  /v1/orgs/{orgId}/clusters/create:
    post:
      operationId: createCluster
      parameters:
      - in: path
        name: orgId
        required: true
        schema:
          type: string
      requestBody:
        content:
          application/json:
            example:
              containerPort: 8000
              gpuModelId: rtx-4090
              gpusPerReplica: 1
              healthCheckPath: /health
              imageUrl: vllm/vllm-openai:latest
              name: vllm-serving
              replicaCount: 2
            schema:
              $ref: '#/components/schemas/CreateClusterRequest'
        required: true
      responses:
        '200':
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ClusterSummary'
          description: Created
        '400':
          $ref: '#/components/responses/BadRequest'
        '401':
          $ref: '#/components/responses/Unauthorized'
        '403':
          $ref: '#/components/responses/Forbidden'
        '409':
          $ref: '#/components/responses/Conflict'
      security:
      - apiKey: []
      summary: Create a cluster
      tags:
      - Clusters
      x-openrelay-mcp:
        default: true
components:
  schemas:
    Error:
      properties:
        code:
          type: string
        error:
          type: string
      required:
      - error
      type: object
    ScaleRequest:
      properties:
        replicaCount:
          minimum: 1
          type: integer
      required:
      - replicaCount
      type: object
    ClusterSummary:
      properties:
        activeReplicas:
          type: integer
        createdAt:
          type: string
        endpointUrl:
          type: string
        gpuModelId:
          type: string
        id:
          type: string
        name:
          type: string
        organizationId:
          type: string
        replicaCount:
          type: integer
        status:
          type: string
      required:
      - id
      - organizationId
      - name
      - status
      type: object
    ClusterPage:
      properties:
        items:
          items:
            $ref: '#/components/schemas/ClusterSummary'
          type: array
        nextCursor:
          type: string
      required:
      - items
      type: object
    CreateClusterRequest:
      properties:
        allowFallback:
          type: boolean
        containerCommand:
          items:
            type: string
          type: array
        containerPort:
          type: integer
        diskSizeGb:
          type: integer
        envVars:
          additionalProperties:
            type: string
          type: object
        gpuModelId:
          type: string
        gpusPerReplica:
          type: integer
        healthCheckPath:
          type: string
        healthCheckPort:
          type: integer
        healthChecks:
          items:
            type: string
          type: array
        imageUrl:
          type: string
        kernelModules:
          items:
            type: string
          type: array
        name:
          type: string
        preferredRegions:
          items:
            type: string
          type: array
        privileged:
          type: boolean
        registryCredentialId:
          type: string
        replicaCount:
          type: integer
        resourceSize:
          type: string
        templateId:
          type: string
        tier:
          type: string
      required:
      - name
      type: object
    GpuModel:
      properties:
        architecture:
          type: string
        createdAt:
          type: string
        hidden:
          type: boolean
        id:
          type: string
        manufacturer:
          type: string
        name:
          type: string
        vramGb:
          type: integer
      required:
      - id
      - name
      - manufacturer
      - vramGb
      - hidden
      type: object
    ClusterDetail:
      properties:
        allowFallback:
          type: boolean
        containerPort:
          type: integer
        createdAt:
          type: string
        deployToken:
          type: string
        diskSizeGb:
          type: integer
        endpointUrl:
          type: string
        envVars:
          additionalProperties:
            type: string
          type: object
        gpuModel:
          $ref: '#/components/schemas/GpuModel'
        gpuModelId:
          type: string
        gpusPerReplica:
          type: integer
        healthCheckPath:
          type: string
        healthCheckPort:
          type: integer
        healthChecks:
          items:
            type: string
          type: array
        id:
          type: string
        imageUrl:
          type: string
        name:
          type: string
        notes:
          type: string
        organizationId:
          type: string
        preferredRegions:
          items:
            type: string
          type: array
        privileged:
          type: boolean
        replicaCount:
          type: integer
        replicas:
          items:
            $ref: '#/components/schemas/ClusterReplicaItem'
          type: array
        resourceSize:
          type: string
        status:
          type: string
        statusReason:
          description: human-readable cause for failed/stuck states
          type: string
        tier:
          type: string
        updatedAt:
          type: string
      required:
      - id
      - organizationId
      - name
      - status
      - gpusPerReplica
      - resourceSize
      - replicaCount
      - tier
      - allowFallback
      - diskSizeGb
      - privileged
      - replicas
      - createdAt
      - updatedAt
      type: object
    ClusterReplicaItem:
      properties:
        consecutiveFailures:
          type: integer
        createdAt:
          type: string
        diskTotalBytes:
          format: int64
          type: integer
        diskUpdatedAt:
          type: string
        diskUsedBytes:
          format: int64
          type: integer
        endpointUrl:
          type: string
        gpuCount:
          type: integer
        healthy:
          type: boolean
        id:
          type: string
        internalIp:
          type: string
        lastHealthCheckAt:
          type: string
        nodeHostname:
          type: string
        nodeId:
          type: string
        nodeLocation:
          type: string
        nodeRegion:
          type: string
        nvlinkEnabled:
          type: boolean
        port:
          type: integer
        sshPort:
          type: integer
        startedAt:
          type: string
        status:
          type: string
      required:
      - id
      - gpuCount
      - status
      - healthy
      - nvlinkEnabled
      - createdAt
      type: object
  responses:
    Conflict:
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Error'
      description: The request conflicts with existing state
    BadRequest:
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Error'
      description: The request is invalid
    Forbidden:
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Error'
      description: API key lacks the required scope
    NotFound:
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Error'
      description: Resource not found
    Unauthorized:
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Error'
      description: Missing or invalid API key
  securitySchemes:
    apiKey:
      description: 'OpenRelay API key. Send it as `Authorization: Bearer vl_…`.'
      scheme: bearer
      type: http