how to get spark-sbumit logging result

Question

When i submit spark job too terminal, it's has logging result like image in terminal.

How can i get it and set it to value or object?

Leonsia · Answer

You can pipe spark-submit command to the log file like this:

spark-submit ... > log.txt

kartheek · Answer

You can see logs from application and you can always write logs to .text files

yarn logs -applicationId  [OPTIONS]

Application ID can be found through cluster UI