Audience
Anyone who wants to to programmatically author, schedule and monitor workflows
About Apache Airflow
Airflow is a platform created by the community to programmatically author, schedule and monitor workflows. Airflow has a modular architecture and uses a message queue to orchestrate an arbitrary number of workers. Airflow is ready to scale to infinity. Airflow pipelines are defined in Python, allowing for dynamic pipeline generation. This allows for writing code that instantiates pipelines dynamically. Easily define your own operators and extend libraries to fit the level of abstraction that suits your environment. Airflow pipelines are lean and explicit. Parametrization is built into its core using the powerful Jinja templating engine. No more command-line or XML black-magic! Use standard Python features to create your workflows, including date time formats for scheduling and loops to dynamically generate tasks. This allows you to maintain full flexibility when building your workflows.
Other Popular Alternatives & Related Software
JS7 JobScheduler
JS7 JobScheduler is an Open Source workload automation system designed for performance, resilience and security. It provides unlimited performance for parallel execution of jobs and workflows. JS7 offers cross-platform job execution, managed file transfer, complex no-code job dependencies and a real REST API.
Platforms
- Cloud scheduling from Containers for Docker®, Kubernetes®, OpenShift® etc.
- True multi-platform scheduling on premises for Windows®, Linux®, AIX®, Solaris®, macOS® etc.
- Hybrid use for cloud and on premises
User Interface
- Modern, no-code GUI for inventory management, monitoring and control with web browsers
- Near real-time information brings immediate visibility of status changes and log output of jobs and workflows
- Multi-client capability, role based access management
High Availability
- Redundancy and Resilience based on asynchronous design and autonomous Agents
- Clustering for all JS7 products, automatic fail-over and manual switch-over
Learn more
Dataiku
Dataiku is an enterprise AI platform designed to help organizations move from fragmented AI efforts to fully scalable and governed AI success. It brings together people, data, and technology into a single system that enables collaboration between domain experts and technical teams. The platform allows users to build, deploy, and manage AI models, analytics workflows, and AI agents with greater efficiency. Dataiku emphasizes orchestration by connecting data sources, applications, and machine learning processes into unified pipelines. It also provides strong governance capabilities, helping organizations monitor performance, control costs, and reduce risks across AI initiatives. Businesses across industries use Dataiku to modernize analytics, automate workflows, and scale machine learning across teams. With proven results from global enterprises, the platform supports faster innovation and measurable ROI through AI-driven solutions.
Learn more
Union Cloud
Union.ai is an award-winning, Flyte-based data and ML orchestrator for scalable, reproducible ML pipelines. With Union.ai, you can write your code locally and easily deploy pipelines to remote Kubernetes clusters.
“Flyte’s scalability, data lineage, and caching capabilities enable us to train hundreds of models on petabytes of geospatial data, giving us an edge in our business.”
— Arno, CTO at Blackshark.ai
“With Flyte, we want to give the power back to biologists. We want to stand up something that they can play around with different parameters for their models because not every … parameter is fixed. We want to make sure we are giving them the power to run the analyses.”
— Krishna Yeramsetty, Principal Data Scientist at Infinome
“Flyte plays a vital role as a key component of Gojek's ML Platform by providing exactly that."
— Pradithya Aria Pura, Principal Engineer at Goj
Learn more
Moxo
Moxo’s service orchestration platform transforms complex B2B relationships into seamless experiences.
Business processes often fragment across departments, clients, vendors, and partners, creating inefficiency and risks. Our platform streamlines these workflows—turning disjointed experiences into smooth, efficient operations that reduce costs and enhance client satisfaction.
Moxo accelerates critical processes including client onboarding, document collection, and exception handling. The results: faster completion times, reduced compliance risks, and superior client experiences.
Leading institutions across financial services, consulting, legal, healthcare, and real estate—including Citibank and BNP Paribas —trust Moxo to orchestrate their mission-critical business relationships.
Learn more
Integrations
Company Information
The Apache Software Foundation
Founded: 1999
United States
airflow.apache.org
Videos and Screen Captures
Other Useful Business Software
Get full visibility and control over your tasks and projects with Wrike.
Wrike offers world-class features that empower cross-functional, distributed, or growing teams take their projects from the initial request stage all the way to tracking work progress and reporting results.
Product Details
Platforms Supported
Cloud
