spark-structured-streaming

327 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to configure backpreasure in Spark 3 Structure Stream Kafka/Files source with Trigger.Once option
user_28707040
•
4
1
150
spark-kafka-integration spark-structured-streaming apache-spark
Read from Kafka topic process the data and write back to Kafka topic using scala and spark
user_113736390
•
3
1
393
spark-structured-streaming apache-kafka apache-spark scala
Spark Structured Streaming - Realtime aggregation for the last X hour(s) data
user_59122690
•
2
0
375
real-time-data spark-structured-streaming apache-spark scala
Kafka with Spark 3.0.1 Structured Streaming : ClassException: org.apache.kafka.common.TopicPartition; class invalid for deserialization
user_151705200
•
2
2
316
spark-structured-streaming pyspark apache-kafka avro java
Kafa + Structured Streaming : Read from topics in parallel
user_50292950
•
2
0
111
spark-structured-streaming batch-processing apache-kafka real-time
Where is Spark structured streaming state of mapGroupsWithState stored?
user_22015660
•
2
2
446
spark-structured-streaming apache-spark
Apache spark custom log unfiltered data (LazyLogging)
user_54469500
•
2
1
57
spark-structured-streaming apache-spark
Spark Structured streaming getting incorrect number of input rows when using StreamingQueryListener QueryProgressEvent
user_148077080
•
2
1
547
spark-streaming spark-structured-streaming apache-spark
Azure Event Hubs Streaming: Does Checkpointing override setStartingPosition?
user_9597880
•
3
1
344
checkpointing azure-eventhub spark-structured-streaming event-driven-design
Track of consumed messages in Spark structured streaming
user_148822930
•
2
1
350
spark-structured-streaming apache-kafka apache-spark java
Hot Questions