apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pyspark - Groupby and collect list over multiple columns and create multiple columns
user_88326410
•
2
1
3043
pyspark apache-spark dataframe python
Spark: More Executors in one machine, longer duration time for each Task
user_73950990
•
2
0
139
pyspark apache-spark-sql apache-spark hadoop scala
How to split a pyspark dataframe column into only two columns (example below)?
user_17452010
•
2
3
1429
pyspark apache-spark-sql apache-spark split
Read and Write configuration settings managment in MongoDB
user_55100010
•
2
1
392
apache-spark-sql apache-spark mongodb scala
How to extract value of json when doing pyspark query
user_14977200
•
2
2
2288
pyspark apache-spark-sql apache-spark
Transfer Scala case class to JsValue in rdd.map func but Task not serializable
user_137239520
•
2
1
132
rdd elasticsearch apache-spark scala
Spark graphFrames - Label Propagation vs. Strongly Connected Components
user_69339930
•
2
1
1378
graphframes apache-spark
Generate multiple columns using partition-batch process without shuffles or custom join logic
user_5250970
•
3
0
81
apache-spark partitioning dataframe join
Read From mongoDB in Scala
user_55100010
•
5
3
976
apache-spark sbt mongodb scala
Does Dataframe coalesce in Spark preserve order?
user_7608070
•
2
2
1137
rdd apache-spark shuffle dataframe
Hot Questions