apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark 3.0.1 Dataframe Operations Work but Spark SQL does not
user_77185530
•
2
0
92
apache-spark-sql apache-spark
I want to know how to count with filter in spark withColumn
user_122253040
•
2
1
137
apache-spark dataframe dataset scala java
SparkSql if value null take previous one
user_22585850
•
2
1
368
pyspark apache-spark-sql apache-spark
AWS EKS Spark 3.0, Hadoop 3.2 Error - NoClassDefFoundError: com/amazonaws/services/s3/model/MultiObjectDeleteException
user_59295710
•
3
2
3336
amazon-eks apache-spark hadoop amazon-s3
Pyspark Cumcount with String Values
user_122314310
•
1
1
104
pyspark apache-spark
Spark event logs for long running process
user_61372010
•
1
0
89
spark-streaming apache-spark-sql apache-spark
Ranking in Spark Structured Streaming
user_145511960
•
1
1
381
spark-structured-streaming apache-spark
In PySpark, using regexp_replace, how to replace a group with value from another column?
user_33965390
•
2
1
1183
pyspark apache-spark-sql apache-spark python
Efficient filtering of a large dataset in Spark based on other dataset
user_145501240
•
2
0
119
apache-spark scala
Spark task fails to write rows into ORC table
user_71355530
•
4
1
381
geospark apache-spark scala
Hot Questions