The data set is big so .glom() and .collect() cannot be used. I have created a hash partition, I am just looking to print the number of records in each partition. I can use .glom() but not .collect() for some reason?
How do i print the number of records in each partition from RDD
Viewed 40
0 Answers
Related