When I hit execute on a cell, especially when I start pyspark, the jupyter lab outputs the log messages to both my terminal & cell output as shown.
I do not want to see those big long messages to appear on jupyter output cell, when I can just see the same messages in the executing terminal (where I jupyter notebook --no-browser --port=8088 --ip=0.0.0.0.
TMIA,
BTW: I do not get this behavior on my personal machine, just on the EMR. So, this must be some config I missed. Already tried: import warnings warnings.filterwarnings('ignore')
