I have installed apache-airflow 2.0 on a new EC2 instance (r5a.xlarge) 4 CPU and 32 RAM and SSD disk. Airflow webserver and scheduler are running in a stable way, BUT the web response is slooooow even with 0 DAGs in execution. The instance lives in N.Virginia as well as the postgres database (AURORA RDS)is running there.
Since the web responsive is slow (~5 seconds for a web page to load) I tried to scale the amount of workers to 7 but seems to be such change dit not helped as expected.
Literally when one do click on whatever link i.e Admin Variables link, the browser has to wait until 5 seconds to receive a response from http://ec2-#-###-###-###.compute-1.amazonaws.com:8080/variable/list/
I would like to listen suggestions from you guys,
so guys, is there any thing that I am missing?
does exist the possibility of split the webserver and scheduler on different instances?
is it just a problem with the UI apart from scheduler and executors?
thanks a lot for any tip, suggestion or fix!