rdd

162 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why does Spark need to serialize data in an RDD for each task it runs?
user_63423400
•
2
2
2829
rdd apache-spark
transform distinct row values to different columns with corresponding rows using Pyspark
user_138849870
•
2
2
243
flatmap rdd pyspark transpose pivot
How to get/build a JavaRDD[DataSet]？
user_139592390
•
2
1
216
nd4j apache-spark-dataset rdd
Spark how can I see data in each partion of a RDD
user_79728110
•
2
1
524
partition rdd apache-spark
how to read multiple text files into a dataframe in pyspark
user_136652040
•
2
1
3592
rdd pyspark databricks dataframe sql
Number of partitions of a spark dataframe?
user_90642400
•
2
2
4384
rdd pyspark apache-spark-sql apache-spark dataframe
How expensive is the conversion from RDD to Dataframe?
user_93892930
•
2
0
86
rdd apache-spark dataframe
Why Spark generate many MapPartitionsRDDs within a simple JDBC transformation?
user_82694930
•
2
0
100
rdd apache-spark
Transfer Scala case class to JsValue in rdd.map func but Task not serializable
user_137239520
•
2
1
132
rdd elasticsearch apache-spark scala
Does Dataframe coalesce in Spark preserve order?
user_7608070
•
2
2
1137
rdd apache-spark shuffle dataframe
Hot Questions