Ashr

Ashr (Ashr Labs) is a testing and evaluation platform for AI agents. It lets teams test agents in real environments, generate realistic user-journey datasets, run graded evaluations across text, voice, image, and file modalities, catch regressions, and monitor agents in production. Ashr integrates as a Python or TypeScript SDK (pip install ashr-labs) into an existing codebase, exposing an AshrLabsClient plus EvalRunner and RunBuilder to fetch a dataset, run it against your agent, submit results for server-side grading, poll graded metrics, and trace production runs. The hosted Ashr Labs console at lab.ashr.io provides datasets, test timelines, prompt versioning, and analytics. Founded by Shreyas Kaps and Rohan Kulkarni; Y Combinator Winter 2026; based in San Francisco.

Ashr is profiled on the APIs.io network. Tagged areas include Company, AI Agents, Agent Testing, Evaluation, and Observability.

Ashr’s developer surface includes documentation, getting-started guide, engineering blog, pricing, support, authentication, and 8 more developer resources.

🌐 Visit website 📡 Source on GitHub

24.4/100 emerging ▬ flat Agent 10/100 human only Full breakdown ↓
scored 2026-07-27 · rubric v0.5

AccessSelf serve

0 APIs

CompanyAI AgentsAgent TestingEvaluationObservabilityLLMDeveloper ToolsSDK

Kin Score

Kin Score How this is scored →
scored 2026-07-27 · rubric v0.5

Composite quality — 24.4/100 · emerging

Contract Quality 0.0 / 25

Developer Ergonomics 8.7 / 20

Commercial Clarity 8.9 / 20

Operational Transparency 0.0 / 13

Governance 0.0 / 12

Discoverability 6.8 / 10

Agent readiness — 10/100 · human only

Machine-Readable Contract 0 / 18

Agentic Access Contract 0 / 15

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 0 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/ashr: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

Get Started 2

Portal, sign-up, and the first successful call

GettingStarted

GettingStarted

Login

Documentation 1

Reference material describing how the API behaves

Documentation

Documentation

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

LLMsTxt

LLMsTxt

Build 2

SDKs, sample code, and the tooling you integrate with

Packages

Packages

SDKs

SDKs

Access & Security 2

Authentication, authorization, and security posture

DomainSecurity

DomainSecurity

Authentication

Authentication

Operate 1

Status, limits, changes, and where to get help

Support

Support

Commercial 3

Pricing, plans, and the legal terms of use

Pricing

Pricing

TermsOfService

TermsOfService

PrivacyPolicy

PrivacyPolicy

Company 2

The organization behind the API

Website

Website

Blog

Blog

Source (apis.yml)

aid: ashr
name: Ashr
description: Ashr (Ashr Labs) is a testing and evaluation platform for AI agents. It lets teams test agents in real environments,
  generate realistic user-journey datasets, run graded evaluations across text, voice, image, and file modalities, catch regressions,
  and monitor agents in production. Ashr integrates as a Python or TypeScript SDK (pip install ashr-labs) into an existing
  codebase, exposing an AshrLabsClient plus EvalRunner and RunBuilder to fetch a dataset, run it against your agent, submit
  results for server-side grading, poll graded metrics, and trace production runs. The hosted Ashr Labs console at lab.ashr.io
  provides datasets, test timelines, prompt versioning, and analytics. Founded by Shreyas Kaps and Rohan Kulkarni; Y Combinator
  Winter 2026; based in San Francisco.
url: https://raw.githubusercontent.com/api-evangelist/ashr/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- y-combinator
x-tier: profiled
x-tier-reason: enriched-from-public-surface
accessModel:
  pricing: unknown
  onboarding: self-serve
  trial: false
  try_now: false
  public: false
  label: Self-serve signup
  confidence: medium
  source:
  - authentication
  generated: '2026-07-22'
  method: derived
specificationVersion: '0.20'
created: '2026-07-17'
modified: '2026-07-18'
image: https://ashr.io/ashr_transparent.png
tags:
- Company
- AI Agents
- Agent Testing
- Evaluation
- Observability
- LLM
- Developer Tools
- SDK
apis: []
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: DomainSecurity
  url: security/ashr-domain-security.yml
- type: Website
  url: https://ashr.io
- type: Documentation
  url: https://ashr.io/docs/python-sdk/overview/
- type: GettingStarted
  url: https://ashr.io/docs/python-sdk/overview/
- type: Blog
  url: https://ashr.io/blog/
- type: Pricing
  url: https://ashr.io/#pricing
- type: Login
  url: https://lab.ashr.io
- type: TermsOfService
  url: https://ashr.io/user_agreement.html
- type: PrivacyPolicy
  url: https://ashr.io/privacy.html
- type: Support
  url: mailto:support@ashr.io
- type: Packages
  url: packages/ashr-packages.yml
- type: SDKs
  url: packages/ashr-packages.yml
- type: Authentication
  url: authentication/ashr-authentication.yml
- type: LLMsTxt
  url: llms/ashr-llms.txt
x-enrichment:
  date: '2026-07-19'
  status: backfilled
  pass: local-v1
  note: backfilled from .gitignore signal + verified work evidence