Athina AI
Athina AI is an LLM monitoring, evaluation, and experimentation platform for building production-grade AI applications. Its REST API lets teams log inferences and traces, manage datasets, run 50+ preset and custom evaluations, version and run prompt templates, and collaborate on experiments across the full LLM development lifecycle.
APIs
Athina Logging & Inferences API
Log LLM inferences and prompt runs (prompt, response, model, tokens, cost, context, customer/session metadata), update logs by id or external reference, and build nested traces ...
Athina Datasets API
Create datasets, list and retrieve datasets, add up to 1000 rows (query, context, response, expected_response and custom fields), update individual cells, and delete datasets us...
Athina Evaluations API
Run single evaluations or suites of 50+ preset and custom evals (RAG, summarization, function-calling, safety) against datasets and logged inferences, with results surfaced in t...
Athina Prompts API
Create and version prompt templates by slug, fetch the default version, and run a prompt by slug with input variables, model, and parameters (temperature, max_tokens, top_p, pen...
Athina Experiments API
Compare prompts, models, and parameters across datasets by combining versioned prompt runs with evaluations, enabling side-by-side experimentation over the prompt and dataset APIs.
Visuals
