Prevent Disabled DAG from Running Instantly When Enabled

user_3023615 0
Viewed 1809

In Airflow 1.10.10, when a disabled DAG is enabled by pressing the button to change it's state from Off to On, the DAG will always run once before the next scheduled run time.

enter image description here

Is it possible to set a DAG to be enabled, but not make its first run until the next time it is scheduled to be run?

Currently, I need to quickly kill the DAG run after I toggle its state to be On.

airflow-scheduler airflow ubuntu
2 Answers

You should set the start_date (which is a datetime) to value after now.

According to the docs

  • the first DAG Run is created based on the minimum start_date for the tasks in your DAG.
  • Subsequent DAG Runs are created by the scheduler process, based on your DAG’s schedule_interval, sequentially.
user_597040

If it is daily task - set start date as below : This will prevent your DAG from running immediately after enabling.

default_args = {
    'start_date': airflow.utils.dates.days_ago(1) 
}

If it is a monthly task - set start date as below :

default_args = {
    'start_date': airflow.utils.dates.days_ago(30) 
}
user_119024430
Related