I want to see the full stack trace in my spark executor logs.
I have for example:
Caused by: java.lang.RuntimeException: java.lang.Long is not a valid external type for schema of int at org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply_0$(generated.java:434) at org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection.apply(generated.java:737) at org.apache.spark.sql.catalyst.encoders.ExpressionEncoder.toRow(ExpressionEncoder.scala:290) ... 18 more
I want to see the 18 more that are missing. I have tried changing to logging level etc but it did not help.