spark-dataframe

113 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is manually managing memory with .unpersist() a good idea?
user_70484210
•
7
1
732
spark-dataframe apache-spark garbage-collection scala
Removing "." from Spark DataFrame column names
user_50607920
•
3
1
4637
spark-dataframe pyspark apache-spark-sql apache-spark
PySpark MongoDB append all elements of an array from DataFrame
user_89472200
•
3
1
1244
pyspark-sql spark-dataframe pyspark apache-spark pymongo
Join/unfolded mapType column in spark back with the original dataframe
user_43040200
•
3
3
2232
flatmap spark-dataframe pyspark
PySpark replace less frequent items with most frequent items
user_15770180
•
3
1
441
spark-dataframe apache-spark-mllib pyspark apache-spark-sql apache-spark
What is a good way to aggregate dataframes in AWS Glue
user_86142030
•
5
1
1710
spark-dataframe aws-glue apache-spark amazon-web-services
Why is dataset.count causing a shuffle! (spark 2.2)
user_59927140
•
16
3
5660
spark-dataframe rdd apache-spark scala
Handling record size more than 3GB in spark
user_74975340
•
5
1
480
spark-dataframe apache-spark hadoop memory-management scala
Spark DF to Hive ORC table - Map type column
user_86583250
•
3
0
963
spark-dataframe apache-spark scala
Count particular characters within a column using Spark Dataframe API
user_68944120
•
6
3
9045
spark-dataframe pyspark apache-spark
Hot Questions