# Promptfoo

**Canonical:** https://apis.io/apis/evals/promptfoo/  
**Provider:** Evals — https://apis.io/providers/evals/  
**Base URL:** https://www.promptfoo.dev  
**Documentation:** https://www.promptfoo.dev/

Promptfoo is one of 20 APIs that [Evals](https://apis.io/providers/evals/) publishes on the [APIs.io](https://apis.io/) network. Tagged areas include Open-Source, CLI, Red Teaming, Assertions, and Test-Driven. The published artifact set on APIs.io includes API documentation and a GitHub repository.

Promptfoo is an open-source CLI and library for evaluating and red-teaming LLM applications. The docs describe it as enabling "test-driven LLM development rather than trial-and-error" and producing "matrix views that let you quickly evaluate outputs across many prompts." It supports assertion-based scoring, integrations across OpenAI, Anthropic, Azure, Google, HuggingFace, and open-source models, plus automated red-team and pentest runs that produce vulnerability and risk reports.

## Machine-readable artifacts (3)

- **Documentation** — https://www.promptfoo.dev/docs/intro/
- **GitHubRepository** — https://github.com/promptfoo/promptfoo
- **RedTeam** — https://www.promptfoo.dev/docs/red-team/

## Other Evals APIs (12)

- [OpenAI Evals](https://apis.io/apis/evals/openai-evals/)
- [Inspect AI](https://apis.io/apis/evals/inspect-ai/)
- [Braintrust](https://apis.io/apis/evals/braintrust/)
- [LangSmith Evaluation](https://apis.io/apis/evals/langsmith-evaluation/)
- [Helicone](https://apis.io/apis/evals/helicone/)
- [Patronus AI](https://apis.io/apis/evals/patronus-ai/)
- [DeepEval (Confident AI)](https://apis.io/apis/evals/deepeval-confident-ai/)
- [Arize AI (Phoenix)](https://apis.io/apis/evals/arize-ai-phoenix/)
- [Galileo](https://apis.io/apis/evals/galileo/)
- [Humanloop](https://apis.io/apis/evals/humanloop/)
- [TruLens](https://apis.io/apis/evals/trulens/)
- [Weights and Biases Weave](https://apis.io/apis/evals/weights-and-biases-weave/)

## Tags

Open-Source, CLI, Red Teaming, Assertions, Test-Driven

---

Profiled by [API Evangelist](https://apievangelist.com) and published on [APIs.io](https://apis.io/apis/evals/promptfoo/). The API's provider profile, Kin Score and agent-readiness rating are at https://apis.io/providers/evals/.