apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Pyspark: java.lang.OutOfMemoryError: GC overhead limit exceeded
user_57716170
•
6
2
8354
pyspark apache-spark-sql apache-spark
How to set SPARK_LOCAL_DIRS parameter using spark-env.sh file
user_52906030
•
6
2
6920
sparklyr apache-spark
How to add any new library like spark-sftp into my Pyspark code?
user_102869970
•
3
1
2180
pyspark apache-spark-sql apache-spark scala
log from spark udf to driver
user_100233800
•
5
2
5958
databricks apache-spark scala
Spark streaming error during job runtime in cluster (yarn resource manager)
user_98453660
•
6
0
300
dstream spark-streaming hadoop-yarn apache-spark
Spark not able to find checkpointed data in HDFS after executor fails
user_21099570
•
3
1
1364
spark-checkpoint spark-streaming apache-spark
java.lang.AssertionError: assertion failed: No plan for HiveTableRelation
user_60444960
•
8
2
5430
apache-spark-sql apache-spark hive amazon-s3 scala
Performance issue while using Window
user_94622570
•
3
0
146
apache-spark scala
How to increase the number of executors that process a certain stage in Spark Streaming/Kafka?
user_102825180
•
3
1
755
spark-streaming apache-kafka apache-spark
Iterate over elements of columns Scala
user_17708510
•
4
2
2191
apache-spark-sql apache-spark scala
Hot Questions