LocalAI

LocalAI Nodes API

The Nodes API from LocalAI — 3 operation(s) for nodes.

Documentation GitHub OpenAPI

Operations 5

GET /api/nodes/models List all loaded models cluster-wide

PUT /api/nodes/{id}/max-replicas-per-model Update a node's max replicas per model

DELETE /api/nodes/{id}/max-replicas-per-model Reset a node's max replicas per model to the worker default

PUT /api/nodes/{id}/vram-budget Update a node's VRAM allocation budget

DELETE /api/nodes/{id}/vram-budget Reset a node's VRAM budget to the worker default

Work with this as data

Every API here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for apis

7 MCP tools reach this

find_apisBrowse and filter every API in the catalog.
get_api_artifactsOne API's artifacts, grouped by type.
get_openapiThe primary OpenAPI for this API.
find_similar_apisAPIs that look like this one.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This API

curl "https://apis.io/api/v1/apis/localai-nodes-api"

All apis

curl "https://apis.io/api/v1/apis?limit=25"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no email required.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.

OpenAPI Specification

openapi: 3.2.0
info:
  description: The LocalAI Rest API.
  title: LocalAI Nodes API
  contact:
    name: LocalAI
    url: https://localai.io
  license:
    name: MIT
    url: https://raw.githubusercontent.com/mudler/LocalAI/master/LICENSE
  version: 2.0.0
servers:
- url: /
tags:
- name: Nodes
paths:
  /api/nodes/models:
    get:
      tags:
      - Nodes
      summary: List all loaded models cluster-wide
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: array
                items:
                  $ref: '#/components/schemas/nodes.NodeModel'
  /api/nodes/{id}/max-replicas-per-model:
    put:
      tags:
      - Nodes
      summary: Update a node's max replicas per model
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: integer
        '400':
          description: value must be >= 1
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/localai.UpdateMaxReplicasPerModelRequest'
        description: New value
        required: true
    delete:
      tags:
      - Nodes
      summary: Reset a node's max replicas per model to the worker default
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: boolean
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
  /api/nodes/{id}/vram-budget:
    put:
      tags:
      - Nodes
      summary: Update a node's VRAM allocation budget
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: string
        '400':
          description: invalid budget
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
      requestBody:
        content:
          application/json:
            schema:
              $ref: '#/components/schemas/localai.UpdateVRAMBudgetRequest'
        description: New value (\
        required: true
    delete:
      tags:
      - Nodes
      summary: Reset a node's VRAM budget to the worker default
      parameters:
      - description: Node ID
        name: id
        in: path
        required: true
        schema:
          type: string
      responses:
        '200':
          description: OK
          content:
            application/json:
              schema:
                type: object
                additionalProperties:
                  type: boolean
        '404':
          description: node not found
          content:
            application/json:
              schema:
                type: object
                additionalProperties: true
components:
  schemas:
    localai.UpdateVRAMBudgetRequest:
      type: object
      properties:
        value:
          description: Value is the VRAM cap ("80%" or "12GB"). Empty string clears the cap.
          type: string
    localai.UpdateMaxReplicasPerModelRequest:
      type: object
      properties:
        value:
          description: Value is the new per-model replica cap on this node. Must be >= 1.
          type: integer
    nodes.NodeModel:
      type: object
      properties:
        address:
          description: gRPC address for this replica's backend process
          type: string
        backend_type:
          description: e.g. "llama-cpp"; used by reconciler to replicate loads
          type: string
        cleanup_attempts:
          type: integer
        cleanup_error:
          type: string
        cleanup_next_retry_at:
          type: string
        config_revision:
          type: string
        created_at:
          type: string
        effective_options_hash:
          type: string
        id:
          type: string
        in_flight:
          description: number of active requests on this replica
          type: integer
        last_used:
          type: string
        loading_by:
          description: frontend ID that triggered loading
          type: string
        model_name:
          type: string
        node_id:
          type: string
        replica_index:
          type: integer
        state:
          description: staging, loading, loaded, unloading, idle
          type: string
        updated_at:
          type: string
  securitySchemes:
    BearerAuth:
      type: apiKey
      name: Authorization
      in: header