hadoop-yarn

186 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark: I see more executors than available cluster's cores
user_99253500
•
2
0
129
azure-hdinsight hadoop-yarn pyspark apache-spark executor
Why could split-brain situation happen in Resourcemanager HA using ZooKeeper
user_112387480
•
1
0
40
resourcemanager hadoop-yarn high-availability apache-zookeeper hadoop
Hive queries taking so long
user_180669620
•
2
1
252
apache-tez hadoop-yarn hive
PySpark runs in YARN client mode but fails in cluster mode for "User did not initialize spark context!"
user_80896950
•
3
1
681
dataproc hadoop-yarn google-cloud-dataproc pyspark apache-spark
Can run code in pyspark shell but the same code fails when submitted with spark-submit
user_80896950
•
2
1
338
spark-submit hadoop-yarn google-cloud-dataproc pyspark apache-spark
Dataproc how to run a initialization-actions script only on master node and skip running on worker nodes
user_123873330
•
2
1
250
hadoop-yarn google-cloud-dataproc apache-spark google-cloud-platform initialization
Is there a way to get the attempt number of a spark job running on yarn
user_95025080
•
2
1
87
hadoop-yarn apache-spark
Spark org.apache.spark.shuffle.FetchFailedException: Caused by: java.nio.channels.ClosedChannelException
user_68755440
•
1
0
528
bigdata hadoop-yarn pyspark apache-spark
Dataproc Install zookeeper latest version on dataproc as zookeeper quorum mode on cluster creation
user_123873330
•
2
1
91
quorum hadoop-yarn google-cloud-dataproc google-cloud-platform
Coursera Bigdata Grader and how to set Hadoop Streaming number of reducers?
user_96590330
•
2
1
44
hadoop-streaming hadoop-yarn hadoop mapreduce bash
Hot Questions