I see exit codes and exit statuses all the time when running spark on yarn:
Here are a few:
CoarseGrainedExecutorBackend: RECEIVED SIGNAL 15: SIGTERM...failed 2 times due to AM Container for application_1431523563856_0001_000002 exited with exitCode: 10......Exit status: 143. Diagnostics: Container killed on request...Container exited with a non-zero exit code 52:......Container killed on request. Exit code is 137...
I have never found any of these messages as being useful....Is there any chance of interpreting what actually goes wrong with these? I have searched high and low for a table explaining the errors but nothing.
The ONLY one I am able to decipher from those above is exit code 52, but that's because I looked at the source code here. It is saying that is an OOM.
Should I stop trying to interpret the rest of these exit codes and exit statuses? Or am I missing some obvious way that these numbers actually mean something?
Even if someone could tell me the difference between exit code, exit status, and SIGNAL that would be useful. But I am just randomly guessing right now, and it seems as everyone else around me who uses spark is, too.
And, finally, why are some of the exit codes less than zero and how to interpret those?
E.g. Exit status: -100. Diagnostics: Container released on a *lost* node