Data Pipelines

Pachyderm

Data lineage and end-to-end pipelines on Kubernetes for enterprises.

Status
UnmaintainedNo commits in 593 days.
Last checked
Checked · Oct 10, 2026
License
Open source
Pricing
Free tier · from $0
Visit Pachyderm Compare with alternatives

What it is

Pachyderm combines data lineage with end-to-end pipelines, running on Kubernetes. It is designed to help enterprises manage complex data workflows efficiently and reliably.

Pachyderm stands out by offering version-controlled data pipelines that are natively integrated with Kubernetes, making it ideal for enterprise-scale data management and reproducibility.

When it fits — and when it doesn’t

A good fit for

  • Teams needing robust data lineage tracking in Kubernetes environments

  • Organizations with complex, version-controlled data processing workflows

  • Enterprises looking to automate and manage machine learning pipelines

Look elsewhere if

  • Small projects or teams without a need for extensive data lineage tracking

  • Projects not running on Kubernetes infrastructure

Known weaknesses

Each one links to the public issue, changelog or docs page it came from, where we have one.

  1. 01

    Limited language support beyond Go and Python

    Primary SDKs are in Go and Python, other languages rely on community-maintained libraries with limited functionality

  2. 02

    Complex setup and configuration for Kubernetes environments

    Requires deep understanding of both Pachyderm and Kubernetes to set up pipelines effectively

What it does well

  • Data lineage tracking

  • Kubernetes-native architecture

  • End-to-end data pipelines

  • Version-controlled data

  • Automated reprocessing

Pricing

Free tier
YesOpen source — free to use
Paid from
$0
Model
Flat rate
Enterprise plan
No

Pricing not independently confirmed — check the vendor’s page.

Performance benchmarks

How Fast Is It?

Set up Pachyderm

Setup steps, common gotchas and what to check after 30 days.

Open the setup guide →
Get the badge

A small badge for Pachyderm’s README or site: its name, “Tracked on AI Navigator”, and the availability status and check month from this page. It updates as the catalog does.

Pachyderm — tracked on AI Navigator

Markdown

[![Pachyderm — tracked on AI Navigator](https://navigateaitools.com/badge/pachyderm.svg)](https://navigateaitools.com/explorer/tool/pachyderm)

HTML

<a href="https://navigateaitools.com/explorer/tool/pachyderm"><img src="https://navigateaitools.com/badge/pachyderm.svg" alt="Pachyderm — tracked on AI Navigator" height="58"></a>