Airflow State of this instance has been externally set to shutdown. Taking the poison pill

Viewed 2791

Some of the Airflow tasks are automatically getting shutdown.

I am using Airflow version 1.10.6 with Celery Executor. The Database is PostgreSQL and Broker is Redis. The airflow infrastructure is deployed on Azure.

Few tasks are getting shutdown after 15 hrs, few are getting stopped after 30 minutes. These are long-running tasks, I have set the execution_timeout to 100 hrs.

Any configuration that can prevent these tasks to be shutdown by Airflow ?

{local_task_job.py:167} WARNING - State of this instance has been externally set to shutdown. Taking the poison pill.
0 Answers
Related