I'm using SparkSubmitOperator in Airflow to submit job to yarn. When my job is failed, it throw exception in log but Airflow mark this DAG is "success".
How to mark DAG to "failed" in this scenario, because I want alert when DAG "failed" to Telegram.
Please help me... Thank you very much!!