glhf · Rate Limits

Glhf Chat Rate Limits

glhf serves an OpenAI-compatible API backed by an auto-scaling GPU scheduler. Public materials note that the service initially launched without rate limiting and that limits have since been applied, but specific per-account or per-model request and token limits are not publicly documented. As an OpenAI-compatible surface, throttling is expected to be returned as HTTP 429. Specific values are not reconciled in this artifact.

Glhf Chat Rate Limits is the machine-readable rate-limit profile for glhf on the APIs.io network, conforming to the API Commons Rate Limits specification.

It captures 3 rate-limit definitions, measuring requests and tokens.

The profile also includes 1 backoff/retry policy defined and response codes documented for throttled.

Tagged areas include AI, LLM, Inference, Open Source Models, and Hugging Face.

3 Limits Throttle: 429
AILLMInferenceOpen Source ModelsHugging FaceRate LimitingQuotasThrottling

Limits

Requests Per Minute (RPM) account
requests
see provider documentation
Not publicly documented; limits applied after initial launch.
Tokens Per Minute (TPM) account
tokens
see provider documentation
Not publicly documented.
Concurrent Requests account
requests
see provider documentation
Governed by the auto-scaling GPU scheduler; not publicly documented.

Policies

Backoff Strategy
Clients should implement exponential backoff with jitter and honor Retry-After on 429 responses.

Sources