spark-structured-streaming

327 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
WriteStream is not able to write Data in Delta Table
user_87652140
•
2
1
1588
delta-lake spark-structured-streaming pyspark databricks
Why sort based aggregation is used instead of hash based when aggregation function over string is used
user_13158330
•
1
0
141
spark-streaming spark-structured-streaming apache-spark-sql apache-spark
TypeError: Object of type StructField is not JSON serializable
user_51411680
•
2
1
742
azure-eventhub spark-structured-streaming pyspark databricks
java.lang.NoSuchMethodError: org.apache.spark.sql.internal.SQLConf.useDeprecatedKafkaOffsetFetching()Z
user_112587880
•
3
1
1528
spark-structured-streaming apache-spark-sql apache-spark scala
spark streaming writing entire data instead incremental
user_46835680
•
1
0
121
spark-structured-streaming apache-spark
How can I control the amount of files being processed for each trigger in Spark Structured Streaming using the "Trigger once" trigger?
user_164308100
•
5
2
3186
spark-structured-streaming pyspark databricks apache-spark python
Spark Structured Streaming read different event types from kafka
user_112587880
•
1
0
61
spark-structured-streaming apache-kafka apache-spark scala
Total records processed in each micro batch spark streaming
user_123358380
•
3
1
1261
spark-streaming spark-structured-streaming pyspark
How can I use aggregate with join in the same query result with Spark?
user_185448200
•
2
2
672
spark-structured-streaming apache-spark scala
cleanSource option does not delete any files
user_115842710
•
2
1
641
delta-lake spark-structured-streaming apache-spark
Hot Questions