spark-structured-streaming

327 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why does Spark Structured Streaming not allow changing the number of input sources?
user_96677210
•
2
2
1030
spark-structured-streaming pyspark apache-kafka apache-spark
Missing Avro Custom Header when using Spark SQL Streaming
user_65300710
•
2
1
664
spark-avro spark-streaming spark-structured-streaming apache-spark-sql apache-spark
When is a Kafka connector preferred over a Spark streaming solution?
user_7608070
•
7
2
2066
spark-structured-streaming apache-kafka-connect apache-kafka apache-spark
spark writeStream into kafka - Difference between awaitTermination() vs awaitAnyTermination()
user_74866210
•
3
1
946
spark-structured-streaming pyspark apache-kafka apache-spark
How to set batch size in one micro-batch of spark structured streaming
user_74866210
•
3
1
3359
spark-structured-streaming pyspark apache-kafka apache-spark
Structured Streaming OOM
user_84236630
•
3
2
1195
spark-streaming spark-structured-streaming apache-spark-sql apache-spark
Spark 3.x Integration with Kafka in Python
user_41327950
•
4
1
3861
spark-kafka-integration spark-structured-streaming pyspark apache-kafka apache-spark
how to implement UNION operation between stream and batch data
user_58153230
•
2
0
205
stream-processing spark-streaming spark-structured-streaming apache-spark-sql scala
Dynamically Expand Arraytype() Columns in Structured Streaming PySpark
user_79896480
•
2
1
349
spark-structured-streaming pyspark apache-spark dynamic python
Why executor memory used is shown greater than total available memory on spark web UI?
user_37245680
•
2
0
260
spark-webui spark-ui spark-structured-streaming apache-spark
Hot Questions