apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
spark scala map column names to output arraytype column for values true
user_44500900
•
2
1
197
apache-spark scala arrays string
sparkSQL filter function not working with NaN
user_62978690
•
2
1
87
apache-spark numpy
How to join 2 dataframes and add a new column based on a filter pyspark
user_100376890
•
2
1
151
pyspark apache-spark dataframe join python
Scala - Error java.lang.NoClassDefFoundError: upickle/core/Types$Writer
user_13696760
•
1
1
134
upickle apache-spark hadoop scala
Parse Date Format
user_91089120
•
3
4
837
pyspark apache-spark-sql apache-spark
Find cumulative average based on column values in spark dataframe
user_165252630
•
1
1
71
pyspark apache-spark python
pyspark list iterate to variable
user_45677350
•
2
1
338
pyspark apache-spark python
EMR not generating step logs
user_129118600
•
1
0
300
amazon-emr apache-spark amazon-web-services hadoop logging
Apache Spark : Long Shuffle Read Blocked Time. Why?
user_100980900
•
2
0
256
databricks apache-spark-sql apache-spark
Pyspark higher order functions - sum 2 values in array of structs at once?
user_99919470
•
2
1
318
pyspark apache-spark-sql apache-spark
Hot Questions