Mux

Mux Storyboards API

APIs for retrieving storyboards, sprites, and metadata about the storyboards from videos hosted using Mux.

GitHub OpenAPI

Operations 3

Each operation below carries the questions people ask an LLM about it and the instructions they give an agent to run it. Generated by API Evangelist overlay

GET /{PLAYBACK_ID}/storyboard.{EXTENSION} Get a storyboard image for hover previews · Retrieve a Storyboard Image for Timeline Hover Previews #
Ask an LLM
“How do I show thumbnail previews when viewers hover over the video timeline?”
“Can I get a single sprite image of thumbnails across my video?”
Tell an agent
Get the {extension} storyboard image for playback {playback_id}.
Fetch the storyboard sprite for playback {playback_id} from {asset_start_time} to {asset_end_time} as {extension}.
GET /{PLAYBACK_ID}/storyboard.vtt Get storyboard tile coordinates as WebVTT · Retrieve Storyboard Metadata in WebVTT Format #
Ask an LLM
“Where do I get the WebVTT file mapping storyboard tiles to timestamps?”
“Can my player read storyboard coordinates from a .vtt file?”
Tell an agent
Get the WebVTT storyboard metadata for playback {playback_id}.
Fetch storyboard.vtt for signed playback {playback_id} with token {token}.
GET /{PLAYBACK_ID}/storyboard.json Get storyboard tile coordinates as JSON · Retrieve Storyboard Metadata in JSON Format #
Ask an LLM
“Can I get storyboard thumbnail positions and time ranges as JSON?”
“Which image format does the JSON storyboard point to, and can I change it?”
Tell an agent
Get the JSON storyboard metadata for playback {playback_id}.
Fetch storyboard.json for playback {playback_id} with images in {format}.

Documentation

📖
Documentation
https://www.mux.com/docs/core/stream-video-files
📖
APIReference
https://www.mux.com/docs/api-reference
📖
Documentation
https://www.mux.com/docs/guides/start-live-streaming
📖
APIReference
https://www.mux.com/docs/api-reference#tag/Live-Streams
📖
Documentation
https://www.mux.com/docs/core/monitor-your-video-streaming-performance
📖
APIReference
https://www.mux.com/docs/api-reference#tag/Video-Views
📖
Documentation
https://www.mux.com/docs/guides/play-your-videos
📖
APIReference
https://www.mux.com/docs/api-reference#tag/Streaming
📖
Documentation
https://www.mux.com/docs/guides/get-images-from-a-video
📖
APIReference
https://www.mux.com/docs/api-reference#tag/Thumbnails
📖
Documentation
https://www.mux.com/docs/guides/mux-robots
📖
APIReference
https://www.mux.com/docs/api-reference#tag/Jobs
📖
Documentation
https://www.mux.com/docs/guides/signing-jwts
📖
APIReference
https://www.mux.com/docs/api-reference#tag/Signing-Keys

Specifications

⚙
OpenAPI
https://raw.githubusercontent.com/api-evangelist/mux-com/refs/heads/main/openapi/mux-com-storyboards-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/mux-com:mux-com-storyboards-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

mux-com-storyboards-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: Mux Storyboards API
  description: Mux is how developers build online video. This API encompasses both Mux Video and Mux Data functionality to help you build your video-related projects better and faster than ever before.
  version: v1
  contact:
    name: Mux DevEx
    url: https://docs.mux.com
    email: devex@mux.com
servers:
- url: https://api.mux.com
  description: Mux Production API
- url: https://image.mux.com
- url: https://stream.mux.com
- url: https://stats.mux.com
tags:
- name: Storyboards
  description: APIs for retrieving storyboards, sprites, and metadata about the storyboards from videos hosted using Mux.
  x-displayName: Storyboards
paths:
  /{PLAYBACK_ID}/storyboard.{EXTENSION}:
    get:
      summary: Retrieve a Storyboard Image for Timeline Hover Previews
      description: Fetch a storyboard image composed of multiple thumbnails for use in timeline hover previews.
      operationId: get-image-storyboard
      servers:
      - url: https://image.mux.com
      tags:
      - Storyboards
      parameters:
      - $ref: '#/components/parameters/playback_id'
      - $ref: '#/components/parameters/token'
      - name: EXTENSION
        in: path
        required: true
        description: The storyboard image extension, either 'jpg', 'png', or 'webp'.
        schema:
          type: string
          enum:
          - jpg
          - png
          - webp
      - $ref: '#/components/parameters/program_start_time'
      - $ref: '#/components/parameters/program_end_time'
      - $ref: '#/components/parameters/asset_start_time'
      - $ref: '#/components/parameters/asset_end_time'
      responses:
        '200':
          description: Storyboard image retrieved successfully.
          content:
            image/jpeg:
              schema:
                type: string
                format: binary
            image/png:
              schema:
                type: string
                format: binary
            image/webp:
              schema:
                type: string
                format: binary
        '400':
          description: Bad request due to invalid parameters.
          content:
            application/json:
              schema:
                $ref: '#/paths/~1%7BPLAYBACK_ID%7D~1storyboard.vtt/get/responses/400/content/application~1json/schema'
              example:
                code: 3
                message: Invalid parameter
        '404':
          description: Video asset not found.
          content:
            application/json:
              schema:
                $ref: '#/paths/~1%7BPLAYBACK_ID%7D~1storyboard.vtt/get/responses/400/content/application~1json/schema'
              example:
                code: 5
                message: Not Found
  /{PLAYBACK_ID}/storyboard.vtt:
    get:
      summary: Retrieve Storyboard Metadata in WebVTT Format
      description: Fetch metadata for the storyboard image in WebVTT format, detailing the coordinates and time ranges of each thumbnail.
      operationId: get-vtt-storyboard
      servers:
      - url: https://image.mux.com
      tags:
      - Storyboards
      parameters:
      - $ref: '#/components/parameters/playback_id'
      - $ref: '#/components/parameters/token'
      - $ref: '#/components/parameters/program_start_time'
      - $ref: '#/components/parameters/program_end_time'
      - $ref: '#/components/parameters/asset_start_time'
      - $ref: '#/components/parameters/asset_end_time'
      responses:
        '200':
          description: WebVTT metadata retrieved successfully.
          content:
            text/vtt:
              schema:
                type: string
        '400':
          description: Bad request due to invalid parameters.
          content:
            application/json:
              schema:
                type: object
                properties:
                  error:
                    type: object
                    required:
                    - message
                    properties:
                      message:
                        type: string
                        description: Description of the error
                      messages:
                        type: array
                        items:
                          type: string
                        description: Description of the errors
                      type:
                        type: string
                        description: Category of the error
                      code:
                        type: integer
                        format: int32
                        description: Internal error code
                  code:
                    type: integer
                    format: int32
                    description: Internal error code
                  message:
                    type: string
                    description: Description of the error
              example:
                code: 3
                message: Invalid parameter
        '404':
          description: Video asset not found.
          content:
            application/json:
              schema:
                $ref: '#/paths/~1%7BPLAYBACK_ID%7D~1storyboard.vtt/get/responses/400/content/application~1json/schema'
              example:
                code: 5
                message: Not Found
  /{PLAYBACK_ID}/storyboard.json:
    get:
      summary: Retrieve Storyboard Metadata in JSON Format
      description: Fetch metadata for the storyboard image in JSON format, detailing the coordinates and time ranges of each thumbnail.
      operationId: get-json-storyboard
      servers:
      - url: https://image.mux.com
      tags:
      - Storyboards
      parameters:
      - $ref: '#/components/parameters/playback_id'
      - $ref: '#/components/parameters/token'
      - $ref: '#/components/parameters/program_start_time'
      - $ref: '#/components/parameters/program_end_time'
      - $ref: '#/components/parameters/asset_start_time'
      - $ref: '#/components/parameters/asset_end_time'
      - name: format
        in: query
        description: The format of the storyboard image URL in the response. Can be either 'jpg', 'png', or 'webp'. Defaults to 'jpg'.
        schema:
          type: string
          enum:
          - jpg
          - png
          - webp
      responses:
        '200':
          description: JSON storyboard retrieved successfully.
          content:
            application/json:
              schema:
                type: string
        '400':
          description: Bad request due to invalid parameters.
          content:
            application/json:
              schema:
                $ref: '#/paths/~1%7BPLAYBACK_ID%7D~1storyboard.vtt/get/responses/400/content/application~1json/schema'
              example:
                code: 3
                message: Invalid parameter
        '404':
          description: Video asset not found.
          content:
            application/json:
              schema:
                $ref: '#/paths/~1%7BPLAYBACK_ID%7D~1storyboard.vtt/get/responses/400/content/application~1json/schema'
              example:
                code: 5
                message: Not Found
components:
  parameters:
    asset_end_time:
      name: asset_end_time
      in: query
      description: Set the relative end time of the asset (in seconds) when using the [instant clipping feature](https://docs.mux.com/guides/create-instant-clips).
      schema:
        type: number
        format: float
    program_end_time:
      name: program_end_time
      in: query
      description: Set the end time of the asset created from a live stream when using the [instant clipping feature](https://docs.mux.com/guides/create-instant-clips). The timestamp should be provided as an epoch integer, and is compared to the program date time (PDT) generated by a live stream.
      schema:
        type: integer
    asset_start_time:
      name: asset_start_time
      in: query
      description: Set the relative start time of the asset (in seconds) when using the [instant clipping feature](https://docs.mux.com/guides/create-instant-clips).
      schema:
        type: number
        format: float
    playback_id:
      name: PLAYBACK_ID
      in: path
      description: The asset or live stream's playback ID.
      required: true
      schema:
        type: string
    token:
      name: TOKEN
      in: query
      description: Signed token (JWT) for [secure video playback](https://docs.mux.com/guides/secure-video-playback).
      schema:
        type: string
    program_start_time:
      name: program_start_time
      in: query
      description: Set the start time of the asset created from a live stream when using the [instant clipping feature](https://docs.mux.com/guides/create-instant-clips). The timestamp should be provided as an epoch integer, and is compared to the program date time (PDT) generated by a live stream.
      schema:
        type: integer
  securitySchemes:
    accessToken:
      description: 'The Mux Video API uses an Access Token and Secret Key for authentication. If you haven''t already, [generate a new Access Token](https://dashboard.mux.com/settings/access-tokens) in the Access Token settings of your Mux account dashboard.


        Once you have an Access Token ID and Secret, you can then simply include those as the username (id) and password (secret) in the same way you use traditional basic auth.

        '
      scheme: basic
      type: http
    authorizationToken:
      description: 'OAuth authorization token, used as a Bearer Auth header

        '
      scheme: bearer
      type: http
x-tagGroups:
- name: Video
  tags:
  - Assets
  - Live Streams
  - Playback ID
  - URL Signing Keys
  - Direct Uploads
  - Delivery Usage
  - Playback Restrictions
  - DRM Configurations
  - Transcription Vocabularies
- name: Data
  tags:
  - Video Views
  - Errors
  - Filters
  - Exports
  - Metrics
  - Monitoring
  - Real-Time
  - Dimensions
  - Incidents
  - Annotations
  - View and Viewer Counts
- name: System
  tags:
  - Signing Keys
  - Utilities
- name: Robots
  tags:
  - Jobs
  - Ask Questions
  - Edit Captions
  - Find Key Moments
  - Generate Chapters
  - Moderate
  - Summarize
  - Translate Captions
- name: Playback
  tags:
  - Thumbnails
  - Animated Images
  - Storyboards
  - Streaming
  - Captions and Transcripts