LocalAI

LocalAI Nodes API

The Nodes API from LocalAI — 3 operation(s) for nodes.

Documentation GitHub OpenAPI

Operations 5

GET /api/nodes/models List all loaded models cluster-wide #

PUT /api/nodes/{id}/max-replicas-per-model Update a node's max replicas per model #

DELETE /api/nodes/{id}/max-replicas-per-model Reset a node's max replicas per model to the worker default #

PUT /api/nodes/{id}/vram-budget Update a node's VRAM allocation budget #

DELETE /api/nodes/{id}/vram-budget Reset a node's VRAM budget to the worker default #

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/localai-nodes-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  description: The LocalAI Rest API.
  title: LocalAI Nodes API
  contact:
    name: LocalAI
    url: https://localai.io
  license:
    name: MIT
    url: https://raw.githubusercontent.com/mudler/LocalAI/master/LICENSE
  version: 2.0.0
servers:
- url: /
tags:
- name: Nodes
paths:
  /api/nodes/models:
    get:
      tags:
      - Nodes
      summary: List all loaded models cluster-wide
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: array
                items:
                  $ref: '#/components/schemas/nodes.NodeModel'
      operationId: getApiNodesModels
      x-operation-id-source: derived
  /api/nodes/{id}/max-replicas-per-model:
    put:
      tags:
      - Nodes
      summary: Update a node's max replicas per model
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: integer
        '400':
          description: value must be >= 1
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/localai.UpdateMaxReplicasPerModelRequest'
        description: New value
        required: true
      operationId: putApiNodesByIdMaxReplicasPerModel
      x-operation-id-source: derived
    delete:
      tags:
      - Nodes
      summary: Reset a node's max replicas per model to the worker default
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: boolean
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
      operationId: deleteApiNodesByIdMaxReplicasPerModel
      x-operation-id-source: derived
  /api/nodes/{id}/vram-budget:
    put:
      tags:
      - Nodes
      summary: Update a node's VRAM allocation budget
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: string
        '400':
          description: invalid budget
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/localai.UpdateVRAMBudgetRequest'
        description: New value (\
        required: true
      operationId: putApiNodesByIdVramBudget
      x-operation-id-source: derived
    delete:
      tags:
      - Nodes
      summary: Reset a node's VRAM budget to the worker default
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: boolean
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
      operationId: deleteApiNodesByIdVramBudget
      x-operation-id-source: derived
components:
  schemas:
    localai.UpdateMaxReplicasPerModelRequest:
      type: object
      properties:
        value:
          description: Value is the new per-model replica cap on this node. Must be >= 1.
          type: integer
    nodes.NodeModel:
      type: object
      properties:
        address:
          description: gRPC address for this replica's backend process
          type: string
        backend_type:
          description: e.g. "llama-cpp"; used by reconciler to replicate loads
          type: string
        cleanup_attempts:
          type: integer
        cleanup_error:
          type: string
        cleanup_next_retry_at:
          type: string
        config_revision:
          type: string
        created_at:
          type: string
        effective_options_hash:
          type: string
        id:
          type: string
        in_flight:
          description: number of active requests on this replica
          type: integer
        last_used:
          type: string
        loading_by:
          description: frontend ID that triggered loading
          type: string
        model_name:
          type: string
        node_id:
          type: string
        replica_index:
          type: integer
        state:
          description: staging, loading, loaded, unloading, idle
          type: string
        updated_at:
          type: string
    localai.UpdateVRAMBudgetRequest:
      type: object
      properties:
        value:
          description: Value is the VRAM cap ("80%" or "12GB"). Empty string clears the cap.
          type: string
  securitySchemes:
    BearerAuth:
      type: apiKey
      name: Authorization
      in: header