Spark - How can get the Logical / Physical Query execution using the following
- Via Thrift
- Via SparkInteractor
Spark - How can get the Logical / Physical Query execution using - Thirft - Hive Interactor
Viewed 20870
2 Answers
If you are using Spark 1, You can get the explain on a query this way:
sqlContext.sql("your SQL query").explain(true)
If you are using Spark 2, it's the same:
spark.sql("your SQL query").explain(true)
The same logic is available on a dataframe:
yourDF.explain(true) or yourDF.someOperation.explain(true)
Where someOperation could be maybe a select on a join or something else.
Related