apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Get information about the current dataproc cluster created after workflow submission
user_77661820
•
2
1
101
google-cloud-dataproc pyspark apache-spark
Spark + s3 - error - java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.s3a.S3AFileSystem not found
user_12649330
•
26
7
60058
apache-zeppelin pyspark apache-spark amazon-s3
Spark on Kubernetes executor cleanup
user_20827090
•
2
2
1328
apache-spark kubernetes
dynamic partition pruning not clear
user_13618150
•
3
2
943
apache-spark-sql apache-spark
Spark (v 2.3.2) dataframe is reading all the columns in an ORC file as string type. is this a normal behaviour?
user_32349940
•
2
2
2229
orc apache-spark
Is there an explanation when spark-csv won't save a DataFrame to file?
user_55168220
•
6
3
2936
spark-csv apache-spark
Scala spark, input dataframe, return columns where all values equal to 1
user_122226940
•
2
3
959
apache-spark-sql apache-spark dataframe filter scala
Spark: how is a window-based processing splitted to executors?
user_19434320
•
4
1
377
bigdata apache-spark-sql apache-spark
Is 'load' command in spark an action or transformation?
user_101329130
•
4
2
2559
pyspark apache-spark
Kappa architecture: when insert to batch/analytic serving layer happens
user_27615090
•
7
1
492
lambda-architecture apache-flink apache-spark architecture streaming
Hot Questions