Pachyderm

Pachyderm is an open-source (Apache-2.0) platform for data-centric pipelines and data versioning, widely used for MLOps. It provides immutable, git-like data lineage through the Pachyderm File System (PFS) and data-driven, containerized pipelines that reprocess only changed data through the Pachyderm Pipeline System (PPS), all running on Kubernetes. The platform is driven by a gRPC/protobuf API with first-party Python, Go, Ruby and Rust clients and the pachctl command-line tool. Pachyderm was acquired by Hewlett Packard Enterprise in January 2023; the standalone marketing, documentation and hosted (Pachyderm Hub) sites have since been retired, but the source, releases, SDKs and CLI remain actively published on GitHub and the language package registries (latest release v2.12.2, January 2025).

Pachyderm publishes 1 API on the APIs.io network. Tagged areas include Company, MLOps, Data Versioning, Data Pipelines, and Data Lineage.

Pachyderm’s developer surface includes documentation, API reference, CLI, authentication, changelog, and 9 more developer resources.

🌐 Visit website 📡 Source on GitHub
19.8/100 emerging ▬ flat Agent 10/100 human only Full breakdown ↓
scored 2026-07-27 · rubric v0.5
AccessSelf serve
1 APIs
CompanyMLOpsData VersioningData PipelinesData LineageMachine LearningKubernetesgRPCOpen Source

Kin Score

Kin Score Kin Score How this is scored →
scored 2026-07-27 · rubric v0.5
Composite quality — 19.8/100 · emerging
Contract Quality 0.0 / 25
Developer Ergonomics 7.8 / 20
Commercial Clarity 0.0 / 20
Operational Transparency 2.7 / 13
Governance 0.0 / 12
Discoverability 9.3 / 10
Agent readiness — 10/100 · human only
Machine-Readable Contract 0 / 18
Agentic Access Contract 0 / 15
MCP Server 0 / 12
Machine-Readable Auth 10 / 10
Idempotency 0 / 9
Stable Error Semantics 0 / 8
Request/Response Examples 0 / 7
Rate-Limit Signaling 0 / 7
Typed Event Surface 0 / 6
Agent Skills 0 / 5
Well-Known Catalog 0 / 4
Consent & Bot Identity 0 / 3
Improve this rating by publishing the missing artifacts — every area above can be raised, and the full rubric is at apis.io/rating/. This rating is computed from github.com/api-evangelist/pachyderm: open an issue to ask a question, or submit a pull request to add artifacts. Want it done for you? Prioritized profiling — $2,500 →

APIs 1

Individual APIs this provider publishes, each with its own machine-readable definition.

Pachyderm gRPC API

Pachyderm's platform API, exposed over gRPC/protobuf. Core services are PFS (data versioning — repos, commits, branches, files) and PPS (pipelines — jobs, datums, pipelines, log...

Security Posture 1

Authentication, domain security, vulnerability disclosure, and trust-center signals.

Pachyderm Authentication

oidc/bearer-token · 3 schemes

SECURITY

Resources

Documentation 2

Reference material describing how the API behaves

Documentation
Documentation
 APIReference
APIReference

Agent Surfaces 1

MCP servers, agent skills, and machine-readable catalogs

LLMsTxt
LLMsTxt

Design & Contract 3

Pagination, idempotency, versioning, errors, and events

Conformance
Conformance
 Conventions
Conventions
 Lifecycle
Lifecycle

Build 5

SDKs, sample code, and the tooling you integrate with

GitHubOrganization
GitHubOrganization
 SourceCode
SourceCode
 Packages
Packages
 SDKs
SDKs
 CLI
CLI

Access & Security 1

Authentication, authorization, and security posture

Authentication
Authentication

Operate 1

Status, limits, changes, and where to get help

ChangeLog
ChangeLog

Other 1

Properties that don't map to a standard resource type

Protobuf
Protobuf

Source (apis.yml)

apis.yml Raw ↑ 
aid: pachyderm
name: Pachyderm
description: Pachyderm is an open-source (Apache-2.0) platform for data-centric pipelines and data versioning, widely used
  for MLOps. It provides immutable, git-like data lineage through the Pachyderm File System (PFS) and data-driven, containerized
  pipelines that reprocess only changed data through the Pachyderm Pipeline System (PPS), all running on Kubernetes. The platform
  is driven by a gRPC/protobuf API with first-party Python, Go, Ruby and Rust clients and the pachctl command-line tool. Pachyderm
  was acquired by Hewlett Packard Enterprise in January 2023; the standalone marketing, documentation and hosted (Pachyderm
  Hub) sites have since been retired, but the source, releases, SDKs and CLI remain actively published on GitHub and the language
  package registries (latest release v2.12.2, January 2025).
accessModel:
  pricing: unknown
  onboarding: self-serve
  trial: false
  try_now: false
  public: false
  label: Self-serve signup
  confidence: medium
  source:
  - authentication
  generated: '2026-07-22'
  method: derived
image: https://avatars.githubusercontent.com/u/10432478?v=4
url: https://raw.githubusercontent.com/api-evangelist/pachyderm/refs/heads/main/apis.yml
x-type: company
x-source: vc-portfolio
x-backed-by:
- dcvc
x-tier: stub
x-tier-reason: portfolio-lead
specificationVersion: '0.20'
created: '2026-07-17'
modified: '2026-07-20'
tags:
- Company
- MLOps
- Data Versioning
- Data Pipelines
- Data Lineage
- Machine Learning
- Kubernetes
- gRPC
- Open Source
apis:
- name: Pachyderm gRPC API
  description: Pachyderm's platform API, exposed over gRPC/protobuf. Core services are PFS (data versioning — repos, commits,
    branches, files) and PPS (pipelines — jobs, datums, pipelines, logs), plus an Auth service (OIDC login, robot tokens,
    RBAC). Self-hosted on a Kubernetes cluster; there is no vendor-hosted public endpoint.
  humanURL: https://github.com/pachyderm/pachyderm/tree/master/src
  baseURL: https://github.com/pachyderm/pachyderm/tree/master/src
  tags:
  - gRPC
  - Data Versioning
  - Data Pipelines
  properties:
  - type: Protobuf
    url: grpc/pachyderm-grpc.yml
  - type: Authentication
    url: authentication/pachyderm-authentication.yml
maintainers:
- FN: Kin Lane
  email: kin@apievangelist.com
- FN: APIs.json
  email: info@apis.io
common:
- type: GitHubOrganization
  url: https://github.com/pachyderm
- type: Documentation
  url: https://github.com/pachyderm/pachyderm/blob/master/README.md
- type: APIReference
  url: https://github.com/pachyderm/pachyderm/tree/master/src
- type: SourceCode
  url: https://github.com/pachyderm/pachyderm
- type: Packages
  url: packages/pachyderm-packages.yml
- type: SDKs
  url: packages/pachyderm-packages.yml
- type: CLI
  url: cli/pachyderm-cli.yml
- type: Protobuf
  url: grpc/pachyderm-grpc.yml
- type: Authentication
  url: authentication/pachyderm-authentication.yml
- type: Conformance
  url: conformance/pachyderm-conformance.yml
- type: Conventions
  url: conventions/pachyderm-conventions.yml
- type: Lifecycle
  url: lifecycle/pachyderm-lifecycle.yml
- type: ChangeLog
  url: changelog/pachyderm-changelog.yml
- type: LLMsTxt
  url: llms/pachyderm-llms.txt
x-enrichment:
  date: '2026-07-20'
  status: enriched
  artifacts_added: 9
  pass: local-v1