In airflow, is there a good way to call another dag's task?

Viewed 25393

I've got dag_prime and dag_tertiary.

  • dag_prime: Scans through a directory and intends to call dag_tertiary on each one. Currently a PythonOperator.
  • dag_tertiary: Scans through the directory passed to it and does (possibly time-intensive) calculations on the contents thereof.

I can call the secondary one from a system call from the python operator, but i feel like there's got to be a better way. I'd also like to consider queuing the dag_tertiary calls, if there's a simple way to do that. Is there a better way than using system calls?

Thanks!

1 Answers
Related