google-cloud-dataproc

423 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Issue while using bigquery with pyspark-Not working with Dataframe transformation operations such as df.filter : action works such as df.show
user_53016530
•
2
0
139
google-cloud-dataproc pyspark google-bigquery etl google-cloud-platform
How to access files on Dataproc that were passed using --files
user_34006380
•
2
2
631
google-cloud-dataproc apache-spark google-cloud-platform scala
GCP Dataproc - Failed to construct kafka consumer, Failed to load SSL keystore dataproc.jks of type JKS
user_68431030
•
2
2
1570
spark-structured-streaming google-cloud-dataproc apache-kafka google-cloud-platform ssl
GCP dataproc - java.lang.NoClassDefFoundError: org/apache/kafka/common/serialization/ByteArraySerializer
user_68431030
•
3
3
1306
google-cloud-dataproc pyspark apache-kafka apache-spark google-cloud-platform
GCP Dataproc - cluster creation failing when using connectors.sh in initialization-actions
user_68431030
•
2
1
542
google-cloud-dataproc apache-spark google-cloud-platform shell
(gcloud.dataproc.batches.submit.spark) unrecognized arguments: --subnetwork=
user_122298310
•
3
1
44
google-cloud-dataproc gcloud apache-spark
DataProc Cluster Restart Job Again From CheckPoint
user_142934860
•
3
0
25
google-cloud-dataproc google-cloud-platform
Dataproc Job Submit Via API
user_142934860
•
2
1
158
google-cloud-dataproc google-cloud-platform java
dataproc spark checkpoint best practices? what should I set the checkpoint dir too?
user_45861800
•
2
1
258
spark-checkpoint google-cloud-dataproc
Why is there just 1 job id in dataproc when there are multiple actions in the pyspark script?
user_80896950
•
2
1
83
dataproc google-cloud-dataproc pyspark apache-spark
Hot Questions