About Me
// Hello, World !
Top Answers
-
Calculating percentage of total count for groupBy using pyspark
17 votes
-
Pyspark rdd : 'RDD' object has no attribute 'flatmap'
10 votes
-
When to use countByValue and when to use map().reduceByKey()
8 votes
-
What is the difference between partitioning and bucketing in Spark?
7 votes
-
Spark - Reading partitioned data from S3 - how does partitioning happen?
6 votes
Top Questions
-
High Concurrency Clusters in Databricks
7 votes2 answers
-
DAG Scheduler vs. Catalyst for Spark
4 votes2 answers
-
Spark caching effect on Optimized Logical Plan
4 votes1 answers
-
Reading first N lines of all files via Spark Scala
3 votes1 answers
-
Spark graphFrames - Label Propagation vs. Strongly Connected Components
2 votes1 answers