apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to rebuild apache Livy with scala 2.12
user_140136900
•
3
4
2355
livy apache-spark
Unsure how to avoid the following type error: found: Any required: String
user_131366020
•
2
2
228
apache-spark scala
Spark EMR Job Failing: Caused by: org.apache.spark.memory.SparkOutOfMemoryError: Unable to acquire 16384 bytes of memory, got 0
user_146660160
•
3
0
836
amazon-emr apache-spark out-of-memory
Why spark.ml CrossValidator gives "Broadcasting large task binary with size X" with big dataset?
user_155729700
•
6
0
568
apache-spark-ml pyspark apache-spark machine-learning
Spark deserialization of dataframe struct inside array of struct
user_33116160
•
1
1
142
parquet apache-spark-sql apache-spark
Compare two Json files using Apache Spark
user_30855200
•
1
1
637
difference apache-spark compare json
Expose spark-ui with zeppelin on kubernetes
user_51483610
•
2
1
357
apache-zeppelin kubernetes-ingress apache-spark kubernetes
How to run pySpark code on multiple workers in AWS glue
user_12487790
•
2
1
187
aws-glue pyspark apache-spark
pyspark only escapes the first quote after a backslash from csv
user_42553020
•
2
1
146
pyspark apache-spark
Spark memory cache keeps increasing even with unpersist
user_116185860
•
2
1
743
amazon-emr pyspark apache-spark memory-management caching
Hot Questions