When can symbols be used to represent columns in spark sql?

Viewed 1895

Consider a basic groupBy expression on a DataFrame:

val groupDf  = rsdf.groupBy("league","vendor").agg(mean('league),mean('vendor))

The groupBy portion is fine: it is using strings for column names. However the agg (/mean) is not - since apparently Symbol were not supported here.

I am wondering why Symbol's do not work here - and when they are permitted in Spark SQL.

1 Answers
Related