Weights and Biases

W&B Serverless Inference (CoreWeave)

OpenAI-compatible inference API for hosted open-source foundation models, running on CoreWeave GPU infrastructure with native Weave tracing and usage tracking.

GitHub

Documentation

📖
Documentation
https://docs.wandb.ai/guides/inference

API entry from apis.yml

apis.yml Raw ↑ 
aid: wandb:serverless-inference
name: W&B Serverless Inference (CoreWeave)
description: OpenAI-compatible inference API for hosted open-source foundation models, running on CoreWeave
  GPU infrastructure with native Weave tracing and usage tracking.
humanURL: https://docs.wandb.ai/guides/inference
baseURL: https://api.inference.wandb.ai/v1
tags:
- Inference
- OpenAI-Compatible
- LLM
- Serverless
properties:
- type: Documentation
  url: https://docs.wandb.ai/guides/inference