description Marquez Overview
Marquez is an open source platform designed to manage and visualize data lineage within complex analytical workflows. It provides a cloud-based solution for tracking data transformations through pipelines, offering interactive visualizations and robust metadata management. Marquez supports teams involved in data analysis, business intelligence, and data engineering who require transparency and control over their data’s journey from origin to insight.
help Marquez FAQ
What does Marquez do in a data platform?
Marquez collects, stores, and visualizes metadata about data jobs and transformations. Its lineage views help show how a dataset moves from an upstream source to downstream tables, reports, or models.
How does Marquez work with OpenLineage?
OpenLineage provides the standard event format, while Marquez acts as a service that consumes and visualizes those lineage events. This lets tools such as Airflow and Spark report metadata into one searchable system.
Is Marquez an open-source project?
Yes, Marquez is maintained as a public open-source project in the MarquezProject GitHub repository. The project is designed as a metadata service for data governance, quality monitoring, and performance analysis.
Does Marquez run data pipelines like Airflow does?
No, Marquez does not replace an orchestrator such as Apache Airflow or a transformation tool such as dbt. It records and displays what those systems did, including upstream and downstream relationships.
explore Explore More
Similar to Marquez
ui.x_see_all arrow_forwardReviews & Comments
Write a Review
Be the first to review
Share your thoughts with the community and help others make better decisions.