Airflow DAG

Apache Airflow™ is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows. Airflow’s extensible Python framework enables you to build workflows connecting with virtually any technology. A web interface helps manage the state of your workflows. Airflow is deployable in many ways, varying from a single process on your laptop to a distributed setup to support even the biggest workflows.

• https://airflow.apache.org/docs/apache-airflow/stable/index.html

A DAG (Directed Acyclic Graph) is the core concept of Airflow, collecting Tasks together, organized with dependencies and relationships to say how they should run.

• https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/dags.html
• https://leeyh0216.github.io/posts/airflow_concept_dag_operator/