Accumulators not showing up in Spark UI

user_5537016 0
Viewed 1857

I have implemented Accumulators to see counts of events in my code. But I cannot see them in the Spark UI. I am using the following things :

val  count_Of_2317508_1 = sc.longAccumulator("count_Of_2317508_1")
 count_Of_2317508_1.add(1)

on some condition.

Is this enough for it to show up on the Spark UI?

apache-spark accumulator scala
1 Answers

You can create accumulators with or without a name, but only named accumulators are displayed in web UI (under Stages tab for a given stage).

Since you have already created named accumulator it should come.

val counter = sc.longAccumulator("counter")

enter image description here

user_30255780
Related