hadoop-yarn

186 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
spark-shell exception org.apache.spark.SparkException: Exception thrown in awaitResult
user_63644790
•
2
1
551
spark-shell hadoop-yarn apache-spark
Dataproc job status
user_108979310
•
2
0
360
hadoop-yarn google-cloud-dataproc pyspark logging
How persist(StorageLevel.MEMORY_AND_DISK) works in Spark 3.1 with Java implementation
user_152605210
•
1
0
79
hadoop-yarn google-cloud-dataproc apache-spark-sql apache-spark hadoop
Apache Spark/scala: Handle yarn kill to perform actions before quitting (clean up resources, save the state)
user_26226570
•
2
1
88
hadoop-yarn apache-spark resource-cleanup kill handler
Partitioning in Spark 3.1 with java
user_152605210
•
2
0
99
hadoop-yarn google-cloud-dataproc apache-spark-sql apache-spark
Yarn/Spark unbalanced node load
user_4023440
•
1
0
49
hadoop-yarn apache-spark
Spark on YARN unexpected number of executors with Google Cloud Dataproc
user_132789060
•
2
1
357
hadoop-yarn google-cloud-dataproc pyspark apache-spark
Hadoop YARN - Job consuming more resources than user limit factor
user_13055830
•
1
1
150
hadoop-yarn hadoop
Spark application exiting with status 143
user_147973970
•
1
1
420
hadoop-yarn pyspark apache-spark
How can I set a maximum allowed execution time per task on Spark-YARN?
user_71573520
•
4
1
247
spark-structured-streaming hadoop-yarn apache-kafka apache-spark
Hot Questions