apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
SparkOutOfMemoryError while loading in the s3 bucket
user_90642400
•
2
2
1684
apache-spark-sql apache-spark out-of-memory amazon-s3 scala
Pyspark retrieve metrics (AUC ROC) from each submodel in CrossValidator
user_137082150
•
2
0
537
apache-spark-mllib cross-validation pyspark apache-spark random-forest
Executor heartbeat timed out after 125009 ms while executing spark jobs from Dataproc cluster
user_136497010
•
2
1
656
google-cloud-dataproc pyspark apache-spark google-cloud-platform shell
Pyspark: Delta table as stream source, How to do it?
user_95621880
•
5
2
3166
delta-lake pyspark databricks apache-spark
Why Spark generate many MapPartitionsRDDs within a simple JDBC transformation?
user_82694930
•
2
0
100
rdd apache-spark
How to allocate image type while creating a dataporc cluster through gcloud command?
user_136497010
•
2
1
132
google-cloud-dataproc gcloud apache-spark google-cloud-platform shell
Get column of list of ratings with 0's in place for missing ratings in Pyspark
user_135918200
•
2
3
211
pyspark apache-spark python
AWS Glue is not able to read JSON Snappy files
user_45031740
•
4
1
1904
aws-glue apache-spark amazon-web-services python
Module not found error when importing Pyspark Delta Lake module
user_19297180
•
2
1
3763
delta-lake spark-structured-streaming pyspark apache-spark
org.apache.spark.SparkException: Could not initialize class com.google.cloud.spark.bigquery.SparkBigQueryConnectorUserAgentProvider
user_136497010
•
2
2
1283
google-cloud-dataproc pyspark apache-spark google-bigquery google-cloud-platform
Hot Questions