apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Dataproc Spark job fails with IO Exception , failing to initial Spark Context when history server trying to access GCS bucket
user_51442680
•
2
0
646
google-cloud-dataproc apache-spark google-cloud-platform java
What went wrong with JVM GC when I launch spark-shell in a shared login node?
user_62618480
•
2
1
256
apache-spark garbage-collection memory-management java
Spark / Scala: Split row into several rows based on value change in current row
user_129693990
•
4
2
335
apache-spark dataframe scala
Custom configuration of Spark partition discovery
user_112131510
•
5
0
251
parquet apache-spark
Spark Kryo Serialization
user_88824140
•
2
0
181
kryo apache-spark-2.0 spark-streaming avro apache-spark
Scala/Spark Apriori implementation extremely slow
user_87370160
•
4
1
298
apache-spark-sql apache-spark scala
Efficient reading/transforming partitioned data in delta lake
user_99919470
•
3
1
1138
delta-lake pyspark apache-spark-sql apache-spark
PYSPARK DF MAP: Get value for given key in spark map
user_109729590
•
4
1
3257
pyspark apache-spark-sql apache-spark
Why is the Spark Property spark.sql.optimizer.metadataOnly being Deprecated
user_98132030
•
2
0
269
pyspark apache-spark
Kryo serialization failed: Buffer overflow
user_105287330
•
2
0
687
amazon-emr pyspark apache-spark-sql apache-spark
Hot Questions