OpenLineage

OpenLineage is an open standard for collecting and managing data lineage metadata across heterogeneous data processing systems.

Reviewed by 7wData

On this page

Profile

OpenLineage provides an open standard for capturing and exchanging data lineage metadata between different data processing and cataloging tools.

OpenLineage is an open standard for collecting and managing data lineage metadata across heterogeneous data processing systems. It was initially developed at WeWork and is now hosted by the Linux Foundation, stewarded as a community-driven specification. The project defines a standard format for emitting lineage events from tools such as Apache Airflow, dbt, Spark, and Flink, enabling interoperability between data orchestration, transformation, and cataloging platforms.

As of June 2026, the GitHub repository shows 2,500 stars, 473 forks, and over 3,200 commits, with active development across client libraries for Java, Python, and integrations with major data tools. The project does not have a corporate parent or disclosed revenue; it operates as a specification and reference implementation. A market research report from Dataintelo valued the broader OpenLineage-for-ETL-lineage-in-finance market at $2.8 billion in 2025, projecting growth to $8.7 billion by 2034 at a 13.4% CAGR, driven by regulatory mandates such as BCBS 239, GDPR, and Dodd-Frank.

The report names Collibra and Informatica as leading commercial platforms in this space, not OpenLineage itself. The project faces the challenge of competing with proprietary lineage solutions from vendors like Collibra, Informatica, and Alation, while relying on volunteer and corporate contributions for maintenance. Adoption is concentrated in financial services, where traceability requirements are strictest, but broader enterprise uptake remains uneven. The project's governance under the Linux Foundation provides vendor neutrality but also means no single entity is responsible for commercial support or long-term funding.

Track OpenLineage and 240+ vendors.

48k+ subscribers read the daily AI & data note. One email, both newsletters. Unsubscribe anytime.

Who buys this

  • Data engineering teams using Apache Airflow, dbt, Spark, or Flink who need to track data provenance
  • Financial institutions subject to regulatory compliance requirements (BCBS 239, GDPR, Dodd-Frank)
  • Data governance and cataloging platform vendors seeking interoperability
  • Cloud providers and data platform companies embedding lineage capabilities
  • Enterprises building internal data observability and governance stacks

Strengths and what to watch

Strengths

  • Vendor-neutral governance under the Linux Foundation reduces risk of single-vendor lock-in and encourages broad community contributions
  • Wide integration coverage across major data tools (Airflow, dbt, Spark, Flink) with active client library development in Java and Python
  • Growing regulatory pressure in financial services creates a clear compliance-driven use case for standardized lineage capture

Watch for

  • No disclosed funding, revenue, or dedicated commercial entity; project sustainability depends on volunteer and corporate contributions without a clear business model
  • Competition from proprietary lineage solutions from Collibra, Informatica, and Alation, which offer deeper enterprise features and commercial support
  • Adoption concentrated in financial services; broader enterprise uptake may be limited by the complexity of integrating lineage collection into existing pipelines

Key Information

Industry
Data Management
Founded
1986

Frequently Asked Questions

What is OpenLineage and what does it do?

OpenLineage is an open standard for collecting and managing data lineage metadata across different data processing systems. It defines a standard format for emitting lineage events from tools like Apache Airflow, dbt, Spark, and Flink, enabling interoperability between platforms.

Who governs the OpenLineage project?

OpenLineage is hosted by the Linux Foundation and governed as a community-driven specification. It was initially developed at WeWork and is now vendor-neutral, reducing the risk of single-vendor lock-in and encouraging broad contributions from the data community.

Which data tools does OpenLineage integrate with?

OpenLineage integrates with major data tools including Apache Airflow, dbt, Spark, and Flink. It provides client libraries for Java and Python, allowing data engineering teams to capture lineage events from these systems and exchange metadata across their data pipelines.

How does OpenLineage help with regulatory compliance in finance?

OpenLineage helps financial institutions meet regulatory mandates like BCBS 239, GDPR, and Dodd-Frank by providing standardized data lineage capture. This enables traceability of data from source to report, which is critical for compliance in financial services where requirements are strictest.

What are the main challenges facing OpenLineage adoption?

OpenLineage faces competition from proprietary lineage solutions from vendors like Collibra, Informatica, and Alation, which offer deeper enterprise features and commercial support. Adoption is concentrated in financial services, and broader enterprise uptake may be limited by integration complexity.

Does OpenLineage have a business model or funding?

OpenLineage has no disclosed funding, revenue, or dedicated commercial entity. It operates as a specification and reference implementation, relying on volunteer and corporate contributions for maintenance. Its sustainability depends on community support without a clear business model.

Sources

  1. github.com — Project metadata: 2,500 stars, 473 forks, 3,220 commits, active development as of June 2026
  2. dataintelo.com — Market size estimate of $2.8B in 2025, projected $8.7B by 2034 at 13.4% CAGR; regulatory drivers; Collibra and Informatica as leading vendors
  3. ir.onelineage.com — Confirms Lineage, Inc. is a temperature-controlled warehouse REIT, not related to OpenLineage project
  4. s203.q4cdn.com — Confirms Lineage, Inc. financial results unrelated to OpenLineage project