In Spark Web UI, there are two DAG visualizations, one for the Job:
the other for the Stage:
as explained here. The blog post does explain about the green dots in the Job's DAG, however, it says nothing about those green-shaded boxes in Stage's DAG. Could someone please give a hint?
Update: If that also means the code indicated is where data is cached, what can we do to improve the performance?