I setup airflow instance using docker compose defined in quickstart. I switched to a LocalExecutor and removed Celery and worker instance. One other change was to increase healthcheck interval to 3600s. Apart from this all default settings. Airflow image version is 2.0.1
This setup on a ec2 t3a.medium instance has an average 20% CPU utilization even when idle, this simply eats up cpu credits. Looking at cpu utilization I see a gunicorn processes popping up regularly. I stopped webserver and the utilization drops to 2%. Is there any configuration change that can be done to lower the cpu usage and what are the tradeoff involved with that?
Webserver logs looks like this.
airflow-webserver_1 | [2021-04-12 14:21:09 +0000] [17] [INFO] Handling signal: ttou
airflow-webserver_1 | [2021-04-12 14:21:09 +0000] [17222] [INFO] Worker exiting (pid: 17222)
airflow-webserver_1 | [2021-04-12 14:21:28 +0000] [17] [INFO] Handling signal: ttin
airflow-webserver_1 | [2021-04-12 14:21:28 +0000] [17237] [INFO] Booting worker with pid: 17237
airflow-webserver_1 | [2021-04-12 14:21:40 +0000] [17] [INFO] Handling signal: ttou
airflow-webserver_1 | [2021-04-12 14:21:40 +0000] [17225] [INFO] Worker exiting (pid: 17225)
airflow-webserver_1 | [2021-04-12 14:21:59 +0000] [17] [INFO] Handling signal: ttin
airflow-webserver_1 | [2021-04-12 14:21:59 +0000] [17240] [INFO] Booting worker with pid: 17240
Thanks