apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark - Fill in null values in a Struct column
user_75203090
•
2
1
1143
pyspark apache-spark-sql apache-spark python
Scala Spark functions like group by, describe() returning incorrect result
user_153458260
•
1
1
142
apache-spark-sql apache-spark scala
What is the difference between bucketBy and partitionBy in Spark?
user_117106320
•
4
2
2287
hdfs pyspark apache-spark partitioning hadoop
Extracting row tag schema from StructType in Scala to parse nested XML
user_55763760
•
2
2
681
databricks apache-spark scala xml xsd
Better way to add column values combinations to data frame in PySpark
user_86921380
•
2
2
247
pyspark apache-spark dataframe performance
EMR classpath conflicts
user_70149170
•
3
1
100
amazon-emr apache-spark amazon-web-services
How do you find out exactly what had caused the high GC time for the spark tasks in any given spark stage?
user_150269410
•
1
2
1680
apache-spark
UDF with Dynamic Data Type
user_21673220
•
3
2
174
apache-spark-sql apache-spark user-defined-functions scala
Reading from parquet is slower than csv -pyspark
user_56762060
•
2
1
388
pyspark apache-spark
HadoopDataSource: Skipping Partition {} as no new files detected @ s3:
user_145493980
•
1
1
700
aws-glue-data-catalog aws-glue apache-spark scala
Hot Questions