How can I obtain the DAG of an Apache Spark job without running it?

Viewed 4183

I have some Scala code that I can run with Spark using spark-submit. From what I understood, Spark creates a DAG in order to schedule the operation.

Is there a way to retrieve this DAG without actually performing the heavy operations, e.g. just by analyzing the code ?

I would like a useful representation such as a data structure or at least a written representation, not the DAG visualization.

1 Answers
Related