DeepInfra Tokenizer API
The Tokenizer API from DeepInfra — 2 operation(s) for tokenizer.
Work with this as data
Every API here is available over the APIs.io API and to AI agents over MCP.
MCP server
One button, every client — Claude, Cursor, VS Code and the rest.
https://apis.io/mcp
Tools for apis
7 MCP tools reach this
find_apisBrowse and filter every API in the catalog.get_api_artifactsOne API's artifacts, grouped by type.get_openapiThe primary OpenAPI for this API.find_similar_apisAPIs that look like this one.apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.resolveTurn a domain, URL or GitHub org into the provider it belongs to.find_cohortsEvery scored population of providers in the catalog.
Call it yourself
curl for this page
This API
curl "https://apis.io/api/v1/apis/deepinfra:deepinfra-tokenizer-api"
All apis
curl "https://apis.io/api/v1/apis?limit=25"Calls without X-API-Key need no key. Calls with it need a paid plan — get a key.
Get an API key
Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.
A second provider on the same verified email joins the account you already have.
OpenAPI Specification
openapi: 3.2.0
info:
title: DeepInfra Tokenizer API
description: The DeepInfra API provides serverless AI inference, custom model deployments, and GPU rentals.
version: 1.0.0
servers:
- url: https://api.deepinfra.com
tags:
- name: Tokenizer
paths:
/v1/tokenize:
post:
tags:
- Tokenizer
summary: Tokenize
operationId: tokenize_v1_tokenize_post
security:
- HTTPBearer: []
parameters:
- name: xi-api-key
in: header
required: false
schema:
anyOf:
- type: string
- type: 'null'
title: Xi-Api-Key
- name: x-api-key
in: header
required: false
schema:
anyOf:
- type: string
- type: 'null'
title: X-Api-Key
requestBody:
required: true
content:
application/json:
schema:
$ref: '#/components/schemas/TokenizeIn'
responses:
'200':
description: Successful Response
content:
application/json:
schema:
$ref: '#/components/schemas/TokenizeOut'
'422':
description: Validation Error
content:
application/json:
schema:
$ref: '#/components/schemas/HTTPValidationError'
/v1/detokenize:
post:
tags:
- Tokenizer
summary: Detokenize
operationId: detokenize_v1_detokenize_post
security:
- HTTPBearer: []
parameters:
- name: xi-api-key
in: header
required: false
schema:
anyOf:
- type: string
- type: 'null'
title: Xi-Api-Key
- name: x-api-key
in: header
required: false
schema:
anyOf:
- type: string
- type: 'null'
title: X-Api-Key
requestBody:
required: true
content:
application/json:
schema:
$ref: '#/components/schemas/DetokenizeIn'
responses:
'200':
description: Successful Response
content:
application/json:
schema:
$ref: '#/components/schemas/DetokenizeOut'
'422':
description: Validation Error
content:
application/json:
schema:
$ref: '#/components/schemas/HTTPValidationError'
components:
schemas:
ValidationError:
properties:
loc:
items:
anyOf:
- type: string
- type: integer
type: array
title: Location
msg:
type: string
title: Message
type:
type: string
title: Error Type
type: object
required:
- loc
- msg
- type
title: ValidationError
TokenizeOut:
properties:
count:
type: integer
title: Count
description: number of tokens
max_model_len:
type: integer
title: Max Model Len
description: the model's maximum context length
tokens:
items:
type: integer
type: array
title: Tokens
description: token ids
token_strs:
anyOf:
- items:
type: string
type: array
- type: 'null'
title: Token Strs
description: per-token strings, if requested (vLLM)
type: object
required:
- count
- max_model_len
- tokens
title: TokenizeOut
DetokenizeOut:
properties:
prompt:
type: string
title: Prompt
description: detokenized text
type: object
required:
- prompt
title: DetokenizeOut
TokenizeIn:
properties:
model:
type: string
title: Model
description: model name
examples:
- my-org/my-dedicated-llm
prompt:
anyOf:
- type: string
- type: 'null'
title: Prompt
description: text to tokenize (completion form)
messages:
anyOf:
- items:
additionalProperties: true
type: object
type: array
- type: 'null'
title: Messages
description: chat messages to tokenize (chat form)
return_token_strs:
anyOf:
- type: boolean
- type: 'null'
title: Return Token Strs
description: also return the per-token strings (vLLM)
additionalProperties: true
type: object
required:
- model
title: TokenizeIn
DetokenizeIn:
properties:
model:
type: string
title: Model
description: model name
examples:
- my-org/my-dedicated-llm
tokens:
items:
type: integer
type: array
title: Tokens
description: token ids to detokenize
additionalProperties: true
type: object
required:
- model
title: DetokenizeIn
HTTPValidationError:
properties:
detail:
items:
$ref: '#/components/schemas/ValidationError'
type: array
title: Detail
type: object
title: HTTPValidationError
securitySchemes:
HTTPBearer:
type: http
scheme: bearer