Why is Spark's show() function very slow?

Viewed 8842

I have

df.select("*").filter(df.itemid==itemid).show()

and that never terminated, however if I do

print df.select("*").filter(df.itemid==itemid)

It prints in less than a second. Why is this?

2 Answers

This usually happens if you dont have enough available memory in computer. free up some memory and try again.

Related