π‘ Pick it for a mature ecosystem, extensive integrations, and enterprise-scale batch workflow orchestration.
Apache Airflow is a platform to programmatically author, schedule and monitor workflows.
Open-source
Ploomber is an open-source framework for building, testing, and deploying data pipelines in Python, SQL, and notebooks. It is aimed at data scientists and engineers who want reproducible DAGs with notebook-friendly development and cloud deployment options.
π‘ Pick it for a mature ecosystem, extensive integrations, and enterprise-scale batch workflow orchestration.
Apache Airflow is a platform to programmatically author, schedule and monitor workflows.
Open-source
π‘ Choose it for a more flexible Python API and hosted orchestration with strong workflow observability.
Prefect is a workflow automation tool built for simplicity and reliability.
Free tier available, paid plans
π‘ Pick it when asset lineage, data quality, and production-grade observability matter more than notebook simplicity.
Dagster is an open-source data orchestrator with a hosted Dagster+ offering for deployment, monitoring, and collaboration. It targets data and machine learning...
Free open source; hosted plans available
π‘ Choose it for a more visual, notebook-like pipeline experience with built-in support for Python, SQL, and R.
Mage is a browser-based AI image-generation platform supporting multiple generative models and image workflows. It targets creators who want fast experimentation with...
Freemium, paid plans available
QuantumBlack, AI by McKinsey
π‘ Pick it for disciplined, modular Python projects that need a clean path from data science experimentation to production.
Kedro is an open-source Python framework for creating maintainable, modular, and reproducible data science and machine learning pipelines. It is intended for...
Free, open source
π‘ Choose it for a lightweight, Python-native dependency graph without the operational complexity of larger orchestrators.
Luigi is a workflow automation tool that helps in building complex pipelines of batch jobs. It simplifies the orchestration of machine learning...
Free and Open Source
Your feedback helps us improve the AI rankings.
β Thanks for your feedback!
Suggest a product and our AI will verify it's a real alternative to Ploomber before adding it to the list.