apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to achieve exactly-once write guaranty with foreachBatch sink in Spark Structured Streaming
user_115905820
•
2
1
532
exactly-once spark-structured-streaming apache-kafka apache-spark-sql apache-spark
Maximum number of concurrent tasks in 1 DPU in AWS Glue
user_81620180
•
3
1
3184
aws-glue apache-spark-sql apache-spark amazon-web-services
Best way to handle Spark Scala API cross join leading to same columns names for both the right and left data frames
user_81900820
•
2
2
352
apache-spark dataframe scala
Spark SQL : Why am I seeing 3 jobs instead of one single job in the Spark UI?
user_18430110
•
5
2
369
spark-ui apache-spark-sql apache-spark
Spark Cassandra Connector Error: java.lang.NoClassDefFoundError: com/datastax/spark/connector/TableRef
user_138221900
•
2
2
1520
spark-structured-streaming spark-cassandra-connector pyspark apache-spark cassandra
Adaptive Query Execution in Spark 3
user_62572820
•
5
1
1006
apache-spark-sql apache-spark shuffle optimization performance
String to Date migration from Spark 2.0 to 3.0 gives Fail to recognize 'EEE MMM dd HH:mm:ss zzz yyyy' pattern in the DateTimeFormatter
user_138213840
•
10
3
31611
pyspark apache-spark-sql apache-spark
Apache spark Row getAs[String] : java.lang.Byte cannot be cast to java.lang.String
user_64518020
•
2
1
1049
apache-spark scala java
How can we pass a variable to where clause in Spark Dataframe
user_138123460
•
2
3
2592
apache-spark-sql apache-spark scala
Filling gaps in time series Spark for different entities
user_109114800
•
2
1
774
pyspark apache-spark
Hot Questions