apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark: Is there a way to convert map type to struct?
user_98066630
•
2
1
858
pyspark apache-spark dataframe
Spark: I see more executors than available cluster's cores
user_99253500
•
2
0
129
azure-hdinsight hadoop-yarn pyspark apache-spark executor
Conflict versions when running spark application on Databricks runtime 10.3
user_182311920
•
2
0
234
azure-databricks apache-spark maven scala
Any workaround for JSONPATH wildcard not supported in Spark SQL
user_182310420
•
2
1
100
apache-spark-sql apache-spark scala
StructuredStreaming withWatermark - TypeError: 'module' object is not callable
user_68431030
•
2
1
182
windowing spark-structured-streaming google-cloud-dataproc apache-spark google-cloud-platform
Profiling the Spark Analyzer: how to access the QueryPlanningTracker for a pyspark query?
user_182171900
•
2
1
248
pyspark apache-spark-sql apache-spark profiling
Why would dataframe.write.mode("overwrite").saveAsTable("table") command be dropping data?
user_17452010
•
2
1
1038
aws-databricks pyspark databricks apache-spark
PySpark: Adding elements from python list into spark.sql() statement
user_113134960
•
3
2
382
pyspark apache-spark list sql python
Synapse spark job fails as input folder does not exist
user_128321980
•
2
1
388
azure-synapse pyspark apache-spark azure
Load many small files(avro) from GCS to pyspark dataframe
user_62558500
•
2
0
199
google-cloud-dataproc pyspark apache-spark google-cloud-platform
Hot Questions