LangSmith

LangSmith Alert Rules API

The alert_rules API from LangSmith — 3 operation(s) for alert_rules.

GitHub OpenAPI

Operations 5

POST /v1/platform/alerts/{session_id} Create an alert rule #
POST /v1/platform/alerts/{session_id}/test Test an alert action to determine if configuration is valid #
GET /v1/platform/alerts/{session_id}/{alert_rule_id} Get an alert rule #
DELETE /v1/platform/alerts/{session_id}/{alert_rule_id} Delete an alert rule #
PATCH /v1/platform/alerts/{session_id}/{alert_rule_id} Update an alert rule #

Documentation

📖
Documentation
https://docs.langchain.com/langsmith
📖
APIReference
https://docs.langchain.com/langsmith/tracing
📖
Documentation
https://docs.langchain.com/langsmith/datasets
📖
Documentation
https://docs.langchain.com/langsmith/evaluation
📖
Documentation
https://docs.langchain.com/langsmith/prompt-hub
📖
Documentation
https://docs.langchain.com/langsmith/feedback
📖
Documentation
https://docs.langchain.com/langsmith/annotation-queues
📖
Documentation
https://docs.langchain.com/langsmith/deployments

Specifications

⚙
OpenAPI
https://artifacts.apis.io/langsmith/openapi/langsmith-alert-rules-api-openapi.yml

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this
  • find_apisBrowse and filter every API in the catalog.
  • get_api_artifactsOne API's artifacts, grouped by type.
  • get_openapiThe primary OpenAPI for this API.
  • find_similar_apisAPIs that look like this one.
  • apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
  • resolveTurn a domain, URL or GitHub org into the provider it belongs to.
  • find_cohortsEvery scored population of providers in the catalog.
All 92 tools →

Call it yourself

curl for this page
This API 
curl "https://apis.io/api/v1/apis/langsmith:langsmith-alert-rules-api"
All apis 
curl "https://apis.io/api/v1/apis?limit=25"

Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

langsmith-alert-rules-api-openapi.yml Raw ↑ 
openapi: 3.2.0
info:
  title: LangSmith Alert Rules API
  description: 'The LangSmith API is used to programmatically create and manage LangSmith resources.


    ## Host

    https://api.smith.langchain.com


    ## Authentication

    To authenticate with the LangSmith API, set the `X-Api-Key` header

    to a valid LangSmith API key.'
  version: 0.1.0
servers:
- url: /
tags:
- name: Alert Rules
paths:
  /v1/platform/alerts/{session_id}:
    post:
      security:
      - API Key: []
      - Tenant ID: []
      - Bearer Auth: []
      description: Creates a new alert rule. The request body must be a JSON-encoded alert rule object that follows the CreateAlertRuleRequest schema.
      tags:
      - Alert Rules
      summary: Create an alert rule
      parameters:
      - description: Session ID
        name: session_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '201':
          description: Alert rule created
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.AlertRuleResponse'
        '400':
          description: Bad request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '429':
          description: Alert Rule Limit Reached
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '500':
          description: Internal server error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '503':
          description: Service unavailable
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/alerts.CreateAlertRuleRequest'
      operationId: postV1PlatformAlertsBySessionId
      x-operation-id-source: derived
  /v1/platform/alerts/{session_id}/test:
    post:
      security:
      - API Key: []
      - Tenant ID: []
      - Bearer Auth: []
      description: Tests an alert action which will fire a notification to all configured recipients if the configuration is valid.
      tags:
      - Alert Rules
      summary: Test an alert action to determine if configuration is valid
      parameters:
      - description: Session ID
        name: session_id
        in: path
        required: true
        schema:
          type: string
      - description: Alert rule ID
        name: alert_rule_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: Alert action fired successfully
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  allOf:
                  - type: string
                  - type: object
                    properties:
                      message:
                        type: string
        '400':
          description: Bad request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '500':
          description: Internal server error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '503':
          description: Service unavailable
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
      operationId: postV1PlatformAlertsBySessionIdTest
      x-operation-id-source: derived
  /v1/platform/alerts/{session_id}/{alert_rule_id}:
    get:
      security:
      - API Key: []
      - Tenant ID: []
      - Bearer Auth: []
      description: Gets an alert rule.
      tags:
      - Alert Rules
      summary: Get an alert rule
      parameters:
      - description: Session ID
        name: session_id
        in: path
        required: true
        schema:
          type: string
      - description: Alert rule ID
        name: alert_rule_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: Alert rule
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.AlertRuleResponse'
        '400':
          description: Bad request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '404':
          description: Not found
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '500':
          description: Internal server error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '503':
          description: Service unavailable
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
      operationId: getV1PlatformAlertsBySessionIdByAlertRuleId
      x-operation-id-source: derived
    delete:
      security:
      - API Key: []
      - Tenant ID: []
      - Bearer Auth: []
      description: Deletes an alert rule
      tags:
      - Alert Rules
      summary: Delete an alert rule
      parameters:
      - description: Session ID
        name: session_id
        in: path
        required: true
        schema:
          type: string
      - description: Alert rule ID
        name: alert_rule_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: Alert rule deleted
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  allOf:
                  - type: string
                  - type: object
                    properties:
                      message:
                        type: string
        '400':
          description: Bad request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '404':
          description: Not found
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '500':
          description: Internal server error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '503':
          description: Service unavailable
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
      operationId: deleteV1PlatformAlertsBySessionIdByAlertRuleId
      x-operation-id-source: derived
    patch:
      security:
      - API Key: []
      - Tenant ID: []
      - Bearer Auth: []
      description: Updates an alert rule.
      tags:
      - Alert Rules
      summary: Update an alert rule
      parameters:
      - description: Session ID
        name: session_id
        in: path
        required: true
        schema:
          type: string
      - description: Alert rule ID
        name: alert_rule_id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: Alert rule updated
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  allOf:
                  - type: string
                  - type: object
                    properties:
                      message:
                        type: string
        '400':
          description: Bad request
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '403':
          description: Forbidden
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '404':
          description: Not found
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '500':
          description: Internal server error
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
        '503':
          description: Service unavailable
          content:
            application/json:
              schema:
                $ref: '#/components/schemas/alerts.ErrorResponse'
      requestBody:
        required: true
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/alerts.UpdateAlertRuleRequest'
      operationId: patchV1PlatformAlertsBySessionIdByAlertRuleId
      x-operation-id-source: derived
components:
  schemas:
    alerts.AlertActionBase:
      type: object
      required:
      - config
      - target
      properties:
        alert_rule_id:
          type: string
        config:
          type: object
        id:
          type: string
        target:
          type: string
          enum:
          - pagerduty
          - webhook
          - dynatrace
    alerts.ErrorResponse:
      type: object
      properties:
        error:
          type: string
          example: 'Invalid request: missing required fields'
    alerts.AlertRule:
      type: object
      required:
      - aggregation
      - attribute
      - description
      - name
      - operator
      - type
      - window_minutes
      properties:
        aggregation:
          type: string
          enum:
          - avg
          - sum
          - pct
        attribute:
          type: string
          enum:
          - latency
          - error_count
          - feedback_score
          - run_latency
          - run_count
          - total_cost
        created_at:
          type: string
        denominator_filter:
          type: string
        description:
          type: string
        filter:
          type: string
        id:
          type: string
        name:
          type: string
        operator:
          type: string
          enum:
          - gte
          - lte
          - gt
          - lt
        session_id:
          type: string
        session_name:
          type: string
        threshold:
          type: number
        threshold_multiplier:
          type: number
        threshold_window_minutes:
          type: integer
          maximum: 60
        type:
          type: string
          enum:
          - threshold
          - change
        updated_at:
          type: string
        window_minutes:
          description: 1-60 minutes for alert rule
          type: integer
          maximum: 60
          minimum: 1
    alerts.AlertRuleBase:
      type: object
      required:
      - aggregation
      - attribute
      - description
      - name
      - operator
      - type
      - window_minutes
      properties:
        aggregation:
          type: string
          enum:
          - avg
          - sum
          - pct
        attribute:
          type: string
          enum:
          - latency
          - error_count
          - feedback_score
          - run_latency
          - run_count
          - total_cost
        denominator_filter:
          type: string
        description:
          type: string
        filter:
          type: string
        id:
          type: string
        name:
          type: string
        operator:
          type: string
          enum:
          - gte
          - lte
          - gt
          - lt
        threshold:
          type: number
        threshold_multiplier:
          type: number
        threshold_window_minutes:
          type: integer
          maximum: 60
        type:
          type: string
          enum:
          - threshold
          - change
        window_minutes:
          description: 1-60 minutes for alert rule
          type: integer
          maximum: 60
          minimum: 1
    alerts.CreateAlertRuleRequest:
      type: object
      required:
      - actions
      - rule
      properties:
        actions:
          type: array
          items:
            $ref: '#/components/schemas/alerts.AlertActionBase'
        rule:
          $ref: '#/components/schemas/alerts.AlertRuleBase'
    alerts.AlertAction:
      type: object
      required:
      - config
      - target
      properties:
        alert_rule_id:
          type: string
        config:
          type: object
        created_at:
          type: string
        id:
          type: string
        target:
          type: string
          enum:
          - pagerduty
          - webhook
          - dynatrace
        updated_at:
          type: string
    alerts.AlertRuleResponse:
      type: object
      properties:
        actions:
          type: array
          items:
            $ref: '#/components/schemas/alerts.AlertAction'
        rule:
          $ref: '#/components/schemas/alerts.AlertRule'
    alerts.UpdateAlertRuleRequest:
      type: object
      required:
      - actions
      - rule
      properties:
        actions:
          type: array
          items:
            $ref: '#/components/schemas/alerts.AlertActionBase'
        rule:
          $ref: '#/components/schemas/alerts.AlertRuleBase'
  securitySchemes:
    API_Key:
      type: apiKey
      in: header
      name: X-API-Key
    Tenant_ID:
      type: apiKey
      in: header
      name: X-Tenant-Id
    Bearer_Auth:
      type: http
      description: Bearer tokens are used to authenticate from the UI. Must also specify x-tenant-id or x-organization-id (for org scoped apis).
      scheme: bearer
    Organization_ID:
      type: apiKey
      in: header
      name: X-Organization-Id