Reduce frequency of Spark Streaming Info logs

Viewed 91

When I deploy my spark streaming job and run it via spark2-submit I get every second such a log message:

21/02/24 21:45:27 INFO yarn.Client: Application report for application_1612163470992_382017 (state: RUNNING)

Is it somehow possible to reduce the interval of such an output (e.g. to every 10 min)? Does anybody know how to do it? I am using Scala Spark 2.3.0.

Thanks.

0 Answers
Related