apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to convert GUID into integer in pyspark
user_151017340
•
1
1
173
aws-glue-spark aws-glue pyspark apache-spark-sql apache-spark
Merge / concatenate an array of maps into one map in spark SQL with built-ins
user_9972530
•
2
3
1283
pyspark apache-spark-sql apache-spark
Spark Shuffle Write Size 7500 times the Input Size
user_3155660
•
1
0
103
partition apache-spark shuffle join
more efficient way to get monthly counts in Python/Pyspark
user_62478640
•
3
2
131
pyspark apache-spark-sql apache-spark sql python
Failed to read part of the files from s3 bucket with Spark
user_117166070
•
2
0
728
google-cloud-dataproc apache-spark amazon-web-services hadoop amazon-s3
Finding the word with maximal length from RDD in SPARK
user_19975670
•
1
2
414
rdd databricks apache-spark function python
How to read parquet in rdd using spark in java
user_114529280
•
1
0
95
parquet apache-spark java
NoClassDefFoundError: org/apache/spark/AccumulatorParam with spark execution engine on hive
user_41766490
•
2
0
472
apache-spark hive hadoop
Conditions in Spark window function
user_51340560
•
2
3
967
pyspark apache-spark-sql apache-spark window-functions
How to Read data from kafka topic with different schema (has some optional objects) in structured streaming
user_134998730
•
2
1
478
spark-structured-streaming apache-kafka apache-spark jsonschema scala
Hot Questions