spark-structured-streaming

327 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Stream-Static join without aggregation still results in accumulating spark state
user_36761790
•
3
0
110
spark-structured-streaming pyspark apache-kafka apache-spark
Generate a single row dataframe for lookup
user_11441570
•
2
1
131
spark-structured-streaming apache-spark-sql apache-spark scala
Cannot process data using Spark Continuous Streaming
user_143541170
•
5
2
1453
spark-structured-streaming pyspark apache-kafka apache-spark
Apache Spark integration with Kafka
user_67070100
•
4
1
547
spark-kafka-integration spark-structured-streaming apache-kafka apache-spark
How to use kafka.group.id and checkpoints in spark 3.0 structured streaming to continue to read from Kafka where it left off after restart?
user_117420300
•
5
1
2892
spark-kafka-integration spark-structured-streaming apache-kafka apache-spark scala
Does Spark Structured Streaming have some timeout issue when reading streams from a Kafka topic?
user_117420300
•
2
1
658
spark-streaming-kafka spark-structured-streaming apache-kafka apache-spark
spark streaming understanding timeout setup in mapGroupsWithState
user_45822400
•
4
1
1975
spark-structured-streaming apache-spark
In Pyspark Structured Streaming, how can I discard already generated output before writing to Kafka?
user_63851050
•
2
0
67
spark-streaming spark-structured-streaming pyspark apache-spark
Spark Stateful Structured Streaming: State getting too big in mapGroupsWithState
user_42180940
•
4
1
758
spark-streaming spark-structured-streaming apache-spark aggregate
Driver stops executors without a reason
user_80327310
•
2
1
687
spark-streaming-kafka spark-structured-streaming apache-spark
Hot Questions