Screenpipe Elements API

Query captured UI accessibility tree data

Operations 1

GET /elements Search UI elements #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API
curl "https://apis.io/api/v1/apis/screenpipe-elements-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

screenpipe-elements-api-openapi.yml Raw ↑
openapi: 3.2.0
info:
  title: Screenpipe Activity Elements API
  version: 1.0.0
  description: 'Screenpipe captures everything you see, say, and hear on your computer. Use this API to search through captured content, manage recordings, and build AI-powered automations on top of your screen data.


    The server runs locally at `http://localhost:3030` by default.'
servers:
- url: http://localhost:3030
  description: Base URL declared by the provider in apis.yml (roadmap#122).
tags:
- name: Elements
  description: Query captured UI accessibility tree data
paths:
  /elements:
    get:
      description: Search elements across all frames with optional FTS, time, and app filters.
      operationId: routes_elements_search_elements
      parameters:
      - name: q
        schema:
          type:
          - string
          - 'null'
        in: query
        style: form
      - name: frame_id
        schema:
          type:
          - integer
          - 'null'
        in: query
        style: form
      - name: source
        schema:
          type:
          - string
          - 'null'
        in: query
        style: form
      - name: role
        schema:
          type:
          - string
          - 'null'
        in: query
        style: form
      - name: start_time
        schema:
          type:
          - string
          - 'null'
          format: date-time
        in: query
        style: form
      - name: end_time
        schema:
          type:
          - string
          - 'null'
          format: date-time
        in: query
        style: form
      - name: app_name
        schema:
          type:
          - string
          - 'null'
        in: query
        style: form
      - name: limit
        schema:
          type: integer
        in: query
        style: form
      - name: offset
        schema:
          type: integer
        in: query
        style: form
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/ElementsListResponse'
      tags:
      - Elements
      summary: Search UI elements
components:
  schemas:
    PaginationResponse:
      type: object
      properties:
        limit:
          type: integer
        offset:
          type: integer
        total:
          type: integer
      required:
      - limit
      - offset
      - total
    BoundsResponse:
      type: object
      properties:
        left:
          type: number
        top:
          type: number
        width:
          type: number
        height:
          type: number
      required:
      - left
      - top
      - width
      - height
    ElementsListResponse:
      type: object
      properties:
        data:
          type: array
          items:
            $ref: '#/components/schemas/ElementResponse'
        pagination:
          $ref: '#/components/schemas/PaginationResponse'
      required:
      - data
      - pagination
    ElementResponse:
      type: object
      properties:
        id:
          type: integer
        frame_id:
          type: integer
        source:
          type: string
        role:
          type: string
        text:
          type:
          - string
          - 'null'
        parent_id:
          type:
          - integer
          - 'null'
        depth:
          type: integer
        bounds:
          $ref: '#/components/schemas/BoundsResponse'
        confidence:
          type:
          - number
          - 'null'
        sort_order:
          type: integer
      required:
      - id
      - frame_id
      - source
      - role
      - text
      - parent_id
      - depth
      - bounds
      - confidence
      - sort_order