GEN

GEN Agent Voice API

Voice library, ElevenLabs integration, prompt-based design (4-step flow), audio-sample cloning, async TTS preview.

GitHub OpenAPI

Operations 11

POST /eleven_labs_job Clone, design, preview, and delete voices — preview voice #
POST /generate_voice_description Clone, design, preview, and delete voices — generate voice description #
POST /generate_voice_sample Clone, design, preview, and delete voices — generate voice script #
POST /hume_ai_sample Clone, design, preview, and delete voices — generate voice samples #
GET /hume_ai_sample/status Discover — sample status #
GET /user_voice_resources Discover — list #
POST /user_voice_resources Clone, design, preview, and delete voices — clone voice #
GET /user_voice_resources/{voice_id} Discover — resource #
DELETE /user_voice_resources/{voice_id} Clone, design, preview, and delete voices — delete voice #
GET /voice_resources Discover — list #
GET /voice_resources/{voice_id} Discover — resource #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/gen-pro:gen-pro-agent-voice-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

gen-pro-agent-voice-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Auto Content Engine Agent Voice API
  description: 'The GEN Auto Content Engine API takes a raw idea all the way to a published video — agent setup, idea research, vidsheet production, layer composition, render, and publish.


    ## The 5-step journey


    Every operation belongs to one phase of a 5-step user journey. Each operation carries an `x-phase` extension you can filter on:


    | Phase | Meaning |

    |-------|---------|

    | `setup` | Step 1 — Set Up Your Agent (identity, voice, personality, API keys, workspaces) |

    | `ideas` | Step 2 — Generate Content Ideas (trending data, research, refinement, preferences) |

    | `convert` | Step 3 — Convert Idea to Vidsheet (clone template or build custom engine) |

    | `edit` | Step 4 — Edit & Generate (cells, layers, creation cards, trigger + poll) |

    | `export` | Step 5 — Export & Publish (render, download, publish to social) |


    Full journey-oriented docs: https://api.gen.pro


    ## Authentication


    All endpoints require authentication via one of:


    - **API Key** (recommended): Pass your API key in the `X-API-Key` header. Create keys on the agent''s API page in the GEN dashboard.

    - **JWT**: Pass a Bearer JWT in the `Authorization: Bearer ` header.


    ## Base URLs


    ```

    https://api.gen.pro/v1 — agent setup, vidsheets, generations, renders, publishing

    https://agent.gen.pro/v1 — content ideas, research, conversations, chat

    https://agent-core.gen.pro/v1 — agent core (brand profile, watchlists, scheduled tasks)

    https://python.gen.pro — social publishing integration (connect, schedule, remove posts)

    ```


    Each operation carries its own `servers` entry, so a generated client or a

    hand-written call goes to the backend that serves the route.


    ## Credits


    All `/v1/vidsheet/` endpoints require an active GEN credit balance.

    If your organization has no usable credits, requests return `422` with error code `usable_gen_credit_required`.


    Credits can be funded with x402 by calling `POST /v1/x402_credit_purchase`

    with `workspace_id` plus `amount_usd` or `credits`. If `network` is omitted,

    GEN returns every configured payment option in `payment_methods` and

    `payment_required.accepts`; show the Sui, Solana, and Base options to the

    user or calling agent and sign one selected accept entry. Workspace funding

    wallets are backend settlement infrastructure; the user-facing payment

    choices are the returned payment methods.'
  version: 1.0.0
  contact:
    name: GEN Support
    url: https://gen.pro
  license:
    name: Proprietary
servers:
- url: https://api.gen.pro/v1
  description: Auto Content Engine API
- url: https://agent.gen.pro/v1
  description: Agent Chat API
- url: https://agent-core.gen.pro/v1
  description: Agent Core API (watchlists)
- url: https://python.gen.pro
  description: Publishing integration API (social connect and scheduling)
security:
- apiKey: []
- bearerAuth: []
tags:
- name: Agent Voice
  description: Voice library, ElevenLabs integration, prompt-based design (4-step flow), audio-sample cloning, async TTS preview.
paths:
  /eleven_labs_job:
    post:
      operationId: postElevenLabsJob
      x-phase: setup
      summary: Clone, design, preview, and delete voices — preview voice
      tags:
      - Agent Voice
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              description: JSON request body.
              required:
              - agent_id
              - user_job
              properties:
                agent_id:
                  type: string
                  description: Agent context; the controller reads params[:agent_id] (`require_agent!`).
                user_job:
                  type: object
                  properties:
                    data: {}
                    container_id: {}
                    container_type: {}
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: object
                properties:
                  user_job_id: {}
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_voice_action
      x-mcp-branch: preview_voice
  /generate_voice_description:
    post:
      operationId: postGenerateVoiceDescription
      x-phase: setup
      summary: Clone, design, preview, and delete voices — generate voice description
      tags:
      - Agent Voice
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              description: JSON request body.
              required:
              - agent_id
              - gender
              properties:
                agent_id:
                  type: string
                  description: Agent context; the controller reads params[:agent_id] (`require_agent!`).
                gender:
                  description: Required; the controller refuses a blank gender.
                voice_description: {}
                language: {}
                script: {}
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: object
                properties:
                  voice_description: {}
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_voice_action
      x-mcp-branch: generate_voice_description
  /generate_voice_sample:
    post:
      operationId: postGenerateVoiceSample
      x-phase: setup
      summary: Clone, design, preview, and delete voices — generate voice script
      tags:
      - Agent Voice
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              description: JSON request body.
              required:
              - agent_id
              properties:
                agent_id:
                  type: string
                  description: Agent context; the controller reads params[:agent_id] (`require_agent!`).
                language: {}
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: object
                properties:
                  voice_sample:
                    description: Generated voice-over script.
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_voice_action
      x-mcp-branch: generate_voice_script
  /hume_ai_sample:
    post:
      operationId: postHumeAiSample
      x-phase: setup
      summary: Clone, design, preview, and delete voices — generate voice samples
      tags:
      - Agent Voice
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              description: JSON request body.
              required:
              - agent_id
              - text
              properties:
                agent_id:
                  type: string
                  description: Agent context; the controller reads params[:agent_id] (`require_agent!`).
                text:
                  description: Script the sample should speak.
                text_var:
                  description: Prompt-variable substitutions for `text`.
                description:
                  description: Style descriptor.
                voice_model_provider:
                  description: fal.ai voice-design provider; defaults to the platform TTS provider.
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
                  properties:
                    generation_id: {}
                    status:
                      description: Present when fal.ai queued the samples.
                      enum:
                      - pending
                    audio:
                      description: Base64/URL audio when Hume AI generated it directly.
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_voice_action
      x-mcp-branch: generate_voice_samples
  /hume_ai_sample/status:
    get:
      operationId: getHumeAiSampleStatus
      x-phase: setup
      summary: Discover — sample status
      tags:
      - Agent Voice
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: object
                properties:
                  generation_id: {}
                  status:
                    enum:
                    - pending
                    - completed
                    - failed
                  queue_position:
                    type: integer
                  error: {}
                  audio: {}
                  speaker_embedding_url: {}
                  voice_model_provider: {}
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_discover
      x-mcp-branch: voice.sample_status
  /user_voice_resources:
    get:
      operationId: getUserVoiceResources
      x-phase: setup
      summary: Discover — list
      tags:
      - Agent Voice
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
                  description: '`app/resources/user_voice_resource_resource.rb`.'
                  properties:
                    id: {}
                    name: {}
                    gender: {}
                    language: {}
                    description: {}
                    provider: {}
                    status: {}
                    user_job_id: {}
                    failed_reason: {}
                    file:
                      description: CDN URL of the attached sample file, or null.
                      type:
                      - string
                      - 'null'
                    user_voice_resource_id:
                      description: Backward-compatible alias of `id`.
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_discover
      x-mcp-branch: voice.list
    post:
      operationId: postUserVoiceResources
      x-phase: setup
      summary: Clone, design, preview, and delete voices — clone voice
      tags:
      - Agent Voice
      requestBody:
        required: true
        content:
          application/json:
            schema:
              type: object
              description: JSON request body.
              required:
              - agent_id
              - user_voice_resource
              properties:
                agent_id:
                  type: string
                  description: Agent context; the controller reads params[:agent_id] (`require_agent!`).
                user_voice_resource:
                  type: object
                  required:
                  - name
                  properties:
                    generation_id: {}
                    name: {}
                    gender: {}
                    language: {}
                    base64_audio: {}
                    audio_url: {}
                    description: {}
                    speaker_embedding_url: {}
                    provider: {}
                    voice_model_provider: {}
                    qwen3_voice_design: {}
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: object
                description: '`app/resources/user_voice_resource_resource.rb`.'
                properties:
                  id: {}
                  name: {}
                  gender: {}
                  language: {}
                  description: {}
                  provider: {}
                  status: {}
                  user_job_id: {}
                  failed_reason: {}
                  file:
                    description: CDN URL of the attached sample file, or null.
                    type:
                    - string
                    - 'null'
                  user_voice_resource_id:
                    description: Backward-compatible alias of `id`.
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_voice_action
      x-mcp-branch: clone_voice
  /user_voice_resources/{voice_id}:
    get:
      operationId: getUserVoiceResourcesByVoiceId
      x-phase: setup
      summary: Discover — resource
      tags:
      - Agent Voice
      parameters:
      - name: voice_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: object
                description: '`app/resources/user_voice_resource_resource.rb`.'
                properties:
                  id: {}
                  name: {}
                  gender: {}
                  language: {}
                  description: {}
                  provider: {}
                  status: {}
                  user_job_id: {}
                  failed_reason: {}
                  file:
                    description: CDN URL of the attached sample file, or null.
                    type:
                    - string
                    - 'null'
                  user_voice_resource_id:
                    description: Backward-compatible alias of `id`.
        '401':
          $ref: '#/components/responses/Unauthorized'
        '404':
          $ref: '#/components/responses/NotFound'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_discover
      x-mcp-branch: voice.resource
    delete:
      operationId: deleteUserVoiceResourcesByVoiceId
      x-phase: setup
      summary: Clone, design, preview, and delete voices — delete voice
      tags:
      - Agent Voice
      parameters:
      - name: voice_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: Success.
        '401':
          $ref: '#/components/responses/Unauthorized'
        '404':
          $ref: '#/components/responses/NotFound'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_voice_action
      x-mcp-branch: delete_voice
  /voice_resources:
    get:
      operationId: getVoiceResources
      x-phase: setup
      summary: Discover — list
      tags:
      - Agent Voice
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: array
                items:
                  type: object
                  description: '`app/resources/voice_resource_resource.rb`.'
                  properties:
                    id: {}
                    name: {}
                    provider: {}
                    url: {}
                    voice_id: {}
                    ownership: {}
                    billing_source: {}
        '401':
          $ref: '#/components/responses/Unauthorized'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_discover
      x-mcp-branch: voice.list
  /voice_resources/{voice_id}:
    get:
      operationId: getVoiceResourcesByVoiceId
      x-phase: setup
      summary: Discover — resource
      tags:
      - Agent Voice
      parameters:
      - name: voice_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: Success.
          content:
            application/json:
              schema:
                type: object
                description: '`app/resources/voice_resource_resource.rb`.'
                properties:
                  id: {}
                  name: {}
                  provider: {}
                  url: {}
                  voice_id: {}
                  ownership: {}
                  billing_source: {}
        '401':
          $ref: '#/components/responses/Unauthorized'
        '404':
          $ref: '#/components/responses/NotFound'
        '422':
          $ref: '#/components/responses/ApiValidationError'
      x-mcp-tool: gen_discover
      x-mcp-branch: voice.resource
components:
  responses:
    NotFound:
      description: Resource not found.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Error'
          example:
            error: Not found
            error_code: not_found
    ApiValidationError:
      description: Validation failed or the request could not be processed.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/ApiError'
    Unauthorized:
      description: Missing or invalid authentication.
      content:
        application/json:
          schema:
            $ref: '#/components/schemas/Error'
          example:
            error: Unauthorized
            error_code: unauthorized
  schemas:
    ApiError:
      type: object
      required:
      - code
      properties:
        code:
          type: string
          description: The stable machine-readable failure code.
        message:
          type: string
          description: Human-readable failure detail.
        errors:
          type: array
          description: Field-level validation failures.
          items:
            type: object
        retryable:
          type: boolean
          description: Whether retrying can succeed without changing the request.
        new_change_set_required:
          type: boolean
          description: Whether the caller must begin a new edit group.
        funding_error_kind:
          type: string
          description: The credit or payment failure category.
    Error:
      type: object
      required:
      - error
      properties:
        error:
          type: string
          description: Human-readable error message.
        error_code:
          type: string
          description: Machine-readable error code.
  securitySchemes:
    apiKey:
      type: apiKey
      in: header
      name: X-API-Key
      description: Personal Access Token (PAT). Create one in Settings > API Keys.
    bearerAuth:
      type: http
      scheme: bearer
      bearerFormat: JWT
      description: Bearer JWT issued by the GEN dashboard sign-in.