I have 3 dags A, B and C. Dag C should get triggered only after tasks in dag A and B completes. Is there a way to implement this in airflow? I am able to set dependency between dag A and C using Triggerdagrun Operator. But when I try to set dependency between dag B and C, C is getting triggered when either A or B completes. Can someone please help me in solving this? I understand that explains external task sensor Operator can be used. But it continuously polls if task in dag A and B is complete which might create performance hit over a period of time.
1 Answers
You could set two more wait-task in your dagc,
then startop >> [wait-daga, wait-dagb] >> dagc.
Below is the link to airflow doc: https://airflow.apache.org/docs/stable/concepts.html
Related