Pachyderm

Pachyderm is an open-source (Apache-2.0) platform for data-centric pipelines and data versioning, widely used for MLOps. It provides immutable, git-like data lineage through the Pachyderm File System (PFS) and data-driven, containerized pipelines that reprocess only changed data through the Pachyderm Pipeline System (PPS), all running on Kubernetes. The platform is driven by a gRPC/protobuf API with first-party Python, Go, Ruby and Rust clients and the pachctl command-line tool. Pachyderm was acquired by Hewlett Packard Enterprise in January 2023; the standalone marketing, documentation and hosted (Pachyderm Hub) sites have since been retired, but the source, releases, SDKs and CLI remain actively published on GitHub and the language package registries (latest release v2.12.2, January 2025).

Pachyderm is listed with 1 API on the APIs.io network. Tagged areas include Company, MLOps, Data Versioning, Data Pipeline, and Data Lineage.

Pachyderm’s developer surface includes documentation, API reference, CLI, authentication, changelog, and 13 more developer resources.

📡 Profile data on GitHub

26.6/100 thin ▬ flat Agent 16/100 agent aware self hosted · Apache-2.0 Full breakdown ↓
scored 2026-10-17 · rubric v0.24.0

1 API

Company MLOpsData VersioningData Pipeline Data Lineage Machine Learning Kubernetes gRPC Open Source

Kin Score

Kin Score How this is scored →
scored 2026-10-17 · rubric v0.24.0

Composite quality — 26.6/100 · thin

Contract Quality 4.5 / 19

Developer Ergonomics 6.4 / 15

Access Clarity 0.0 / 15

Operational Transparency 1.8 / 10

Contract Governance 0.4 / 9

Discoverability 5.5 / 8

Regulatory Posture 1.5 / 15

Open Source Surface 5.0 / 10

Agent readiness — 16/100 · agent aware

Machine-Readable Contract 18 / 18

Agentic Access Contract 0 / 10

Documented Reversibility 0 / 6

MCP Server 0 / 12

Machine-Readable Auth 10 / 10

Idempotency 0 / 9

Stable Error Semantics 0 / 8

Request/Response Examples 0 / 7

Rate-Limit Signaling 0 / 7

Typed Event Surface 0 / 6

Agent Skills 0 / 5

Well-Known Catalog 0 / 4

Consent & Bot Identity 0 / 3

A2A Agent Card 0 / 8

Dry-Run / Simulate Mode 0 / 4

Delegated User Identity 0 / 6

Protected Resource Metadata 0 / 5

Registration Without a Human 0 / 6

Agentic Commerce Well-Known Document 0 / 5

Regulatory Posture applies to this provider. Its tags matched the Horizontal (data, software, accessibility, platform) regime, so Regulatory Posture carries 15 points of the composite. If this regime is wrong for your business, say so on your provider repo — the applicability map is public and we will correct it.

Open Source Surface applies to this provider. This product is open source and we read its repository directly, so Open Source Surface carries 10 points of the composite. It is scored from what the repository actually publishes — a security policy, a contribution guide, a release history, a code of conduct — read live from the provider rather than inferred from our own catalog pointers. This facet adds; nothing was taken away to make room for it. An open-source project is not excused from the commercial facets, because exemption would strip it of the points it does earn. If we have the wrong repository, or this product is not open source, say so on your provider repo and we will drop the facet rather than have you publish against it.

Create-or-Update Ergonomics could not be measured. We hold no machine-readable contract for this provider to read, so there is nothing to measure a write surface against. Excluded rather than scored zero: never-measured and measured-empty are different facts. Publishing an OpenAPI is what makes this facet — and several others — scorable at all.

The six quality facets above are damped to 75 points between them, because both conditional facets apply and carry 25 points together. That is why each facet's contribution is shown against a damped maximum: raising a quality facet moves the composite by 75% of its nominal weight, not 100%. The full arithmetic is at apis.io/rating/.

Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. Every facet and dimension name above is a link: it opens that measurement's own page — what it means, the exact checks that feed it, how the whole catalog distributes on it, and the providers at the top of it. This rating is computed from github.com/api-evangelist/pachyderm: open an issue to ask a question, or submit a pull request to add artifacts. Submit an artifact on GitHub — free → Manage your own listing — the Influence plan, $499/mo →

Markets this provider is in provisional

The Kin Score Market layer reads a provider inside its market: its position, and how deep its integrations go. Depth is only comparable within a position. Provisional and unweighted: not part of the Kin Score or agent readiness.

Market	Position	Depth	Registered MCP server	Declares compatibility
MLOps and AI/ML Infrastructure (LF AI & Data, MLPerf, Kubeflow)	undeclared	-	-	-

Registered MCP server and declares compatibility are report only — not weighted. Undeclared means we found nothing we can read, so there is no number: we never infer integrations.

Standards implemented 1

Standards this provider implements or carries. De facto ones are profiled and measured by the API Commons; formal ones come from the standards directory and are linked by the provider's own tags. The evidence column says how each claim was established — not that it was made.

gRPC

tagged — the provider's own APIs.json carries the standard as a tag; implementation not verified

APIs 1

Individual APIs this provider publishes, each with its own machine-readable definition.

Pachyderm gRPC API

Pachyderm's platform API, exposed over gRPC/protobuf. Core services are PFS (data versioning — repos, commits, branches, files) and PPS (pipelines — jobs, datums, pipelines, log...

Security Posture 1

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Pachyderm Authentication

oidc/bearer-token · 3 schemes

SECURITY

Resources

Documentation 3

Reference material describing how the API behaves

ContributionGuide

ContributionGuide

Documentation

Documentation

APIReference

APIReference

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

LLMsTxt

LLMsTxt

Design & Contract 3

Pagination, idempotency, versioning, errors, and events

Conformance

Conformance

Conventions

Conventions

Lifecycle

Lifecycle

Build 5

SDKs, sample code, and the tooling you integrate with

GitHubOrganization

SourceCode

Packages

SDKs

CLI

Access & Security 1

Authentication, authorization, and security posture

Authentication

Authentication

Operate 3

Status, limits, changes, and where to get help

IssueTracker

IssueTracker

Releases

Releases

ChangeLog

ChangeLog

Commercial 1

Pricing, plans, and the legal terms of use

License

License

Other 1

Properties that don't map to a standard resource type

Protobuf

Protobuf

Source (apis.yml)

aid: pachyderm
name: Pachyderm
description: Pachyderm is an open-source (Apache-2.0) platform for data-centric pipelines and data versioning, widely used
  for MLOps. It provides immutable, git-like data lineage through the Pachyderm File System (PFS) and data-driven, containerized
  pipelines that reprocess only changed data through the Pachyderm Pipeline System (PPS), all running on Kubernetes. The platform
  is driven by a gRPC/protobuf API with first-party Python, Go, Ruby and Rust clients and the pachctl command-line tool. Pachyderm
  was acquired by Hewlett Packard Enterprise in January 2023; the standalone marketing, documentation and hosted (Pachyderm
  Hub) sites have since been retired, but the source, releases, SDKs and CLI remain actively published on GitHub and the language
  package registries (latest release v2.12.2, January 2025).
deliveryModel:
  model: self-hosted
  license: Apache-2.0
  open_source: true
  commercial: false
  callable_host: false
  label: Self-hosted open source · you run it yourself
  confidence: high
  source:
  - license
  generated: '2026-08-28'
  method: derived
accessModel:
  pricing: unknown
  onboarding: unknown
  trial: false
  try_now: false
  public: false
  label: Unknown
  confidence: low
  source:
  - authentication
  generated: '2026-09-03'
  method: derived
image: https://avatars.githubusercontent.com/u/10432478?v=4
url: https://raw.githubusercontent.com/api-evangelist/pachyderm/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- dcvc
x-tier: stub
x-tier-reason: portfolio-lead
specificationVersion: '0.23'
created: '2026-07-17'
modified: '2026-07-20'
tags:
- Company
- MLOps
- Data Versioning
- Data Pipeline
- Data Lineage
- Machine Learning
- Kubernetes
- gRPC
- Open Source
tags_raw:
- Company
- MLOps
- Data Versioning
- Data Pipelines
- Data Lineage
- Machine Learning
- Kubernetes
- gRPC
- Open Source
- Machine-Learning
- Open-Source
apis:
- name: Pachyderm gRPC API
  description: Pachyderm's platform API, exposed over gRPC/protobuf. Core services are PFS (data versioning — repos, commits,
    branches, files) and PPS (pipelines — jobs, datums, pipelines, logs), plus an Auth service (OIDC login, robot tokens,
    RBAC). Self-hosted on a Kubernetes cluster; there is no vendor-hosted public endpoint.
  humanURL: https://github.com/pachyderm/pachyderm/tree/master/src
  baseURL: https://github.com/pachyderm/pachyderm/tree/master/src
  tags:
  - gRPC
  - Data Versioning
  - Data Pipeline
  tags_raw:
  - gRPC
  - Data Versioning
  - Data Pipelines
  properties:
  - type: Protobuf
    url: grpc/pachyderm-grpc.yml
  - type: Authentication
    url: authentication/pachyderm-authentication.yml
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: IssueTracker
  url: https://github.com/pachyderm/pachyderm/issues
- type: Releases
  url: https://github.com/pachyderm/pachyderm/releases
- type: ContributionGuide
  url: https://github.com/pachyderm/pachyderm/blob/master/CONTRIBUTING.md
- type: License
  name: Apache-2.0
  url: https://github.com/pachyderm/pachyderm/blob/master/LICENSE
- type: GitHubOrganization
  url: https://github.com/pachyderm
- type: Documentation
  url: https://github.com/pachyderm/pachyderm/blob/master/README.md
- type: APIReference
  url: https://github.com/pachyderm/pachyderm/tree/master/src
- type: SourceCode
  url: https://github.com/pachyderm/pachyderm
- type: Packages
  url: packages/pachyderm-packages.yml
- type: SDKs
  url: packages/pachyderm-packages.yml
- type: CLI
  url: cli/pachyderm-cli.yml
- type: Protobuf
  url: grpc/pachyderm-grpc.yml
- type: Authentication
  url: authentication/pachyderm-authentication.yml
- type: Conformance
  url: conformance/pachyderm-conformance.yml
- type: Conventions
  url: conventions/pachyderm-conventions.yml
- type: Lifecycle
  url: lifecycle/pachyderm-lifecycle.yml
- type: ChangeLog
  url: changelog/pachyderm-changelog.yml
- type: LLMsTxt
  url: llms/pachyderm-llms.txt
x-enrichment:
  date: '2026-07-20'
  status: enriched
  artifacts_added: 9
  pass: local-v1

Work with this as data

Every provider here is available over the APIs.io API and to AI agents over MCP.

MCP server

One button, every client — Claude, Cursor, VS Code and the rest.

https://apis.io/mcp

Tools for providers

9 MCP tools reach this

find_providersBrowse and filter every provider in the catalog.
get_provider_artifactsEvery artifact this provider publishes, grouped by type.
get_provider_operationsEvery operation across all of their OpenAPIs — one call instead of parsing every spec.
get_provider_toolsEvery MCP tool they ship, with the operation each wraps.
get_provider_evidenceHow each part of their score was established. Free — the basis for a claim should not sit behind it.
get_provider_ratingPRO — composite, band, trend and facet scores.
apis_io_searchSTART HERE — APIs, providers and tags for one query, each with its total.
resolveTurn a domain, URL or GitHub org into the provider it belongs to.
find_cohortsEvery scored population of providers in the catalog.

All 92 tools →

Call it yourself

curl for this page

This provider

curl "https://apis.io/api/v1/providers/pachyderm"

All providers

curl "https://apis.io/api/v1/providers?limit=25"

Every operation they expose

curl "https://apis.io/api/v1/providers/pachyderm/operations?limit=25"

How their score was established

curl "https://apis.io/api/v1/providers/pachyderm/evidence"

Discovery needs no key. Ratings and market analysis are Pro.

Get an API key

Free tier, no form to fill in. Signing in shares your email address with us — we store it to create your key and to recognise you if you sign in with another provider. See our Privacy Policy and Terms.

GitHub Google LinkedIn

A second provider on the same verified email joins the account you already have.