apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How do you get the driver and executors to load and recognize the postgres driver in EMR with spark-submit?
user_30165150
•
4
1
510
amazon-emr apache-spark driver hadoop postgresql
stop auto unpersist of dataframe after writing to hive table
user_83725760
•
3
1
197
pyspark apache-spark persist hive dataframe
Spark write Dataset in kafka, enable KryoSerializer
user_87711560
•
4
0
1141
apache-kafka apache-spark serialization json java
Required executor memory is above the max threshold of this cluster
user_93321510
•
2
1
6264
apache-spark hadoop
How to kill apache spark application running in background after killing it from SPARK web UI
user_35351400
•
2
3
2948
apache-spark sigkill python
Any fix for UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream?
user_74313490
•
4
1
2202
pyspark pyarrow pandas apache-spark
Use GCS staging directory for Spark jobs (on Dataproc)
user_24546770
•
3
1
2576
hadoop-yarn google-cloud-storage google-cloud-dataproc apache-spark
How to attachHandler to sparkUI
user_19962960
•
3
1
83
apache-spark
How to set maximum number of rows in one micro-batch?
user_116073780
•
4
2
4940
spark-structured-streaming apache-spark redis
Does Hive preserve file order when selecting data
user_116737910
•
3
1
1886
hiveql apache-spark-sql apache-spark hive hadoop
Hot Questions