How to count unique values on pyspark

Nabih Bawazir 0
Viewed 18

Here's my dataset

Food     Day
Chiken   2
Chiken   6
Chiken   2
Beef     3
Chiken   4
Beef     6
Beef     7

My Output

Food        Day_Count
Chicken            3
Beef               3

Chicken is 3, because it shows in day 2,4,6 and Beef is 3, because it shows in day 3,6,7

pyspark
1 Answers

Your question is vague. I presume you want to find get unique days for each group of food?

df.groupBy('Food').agg(countDistinct('Day').alias('count')).show()
wwnde0
Related