spark-streaming

275 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
One Kafka consumer in a group consistently rejects coordinator, but only when Spark and Kafka are both in EC2
user_72599260
•
6
1
961
spark-streaming apache-kafka apache-spark amazon-ec2
Spark Streaming receiver is processing only one record
user_21453680
•
2
1
122
spark-streaming hadoop-yarn google-cloud-dataproc apache-spark
Spark Streaming does not recover pending batches (TextFileStream)
user_30468340
•
2
0
409
spark-streaming apache-spark scala
How to solve the following issue in Spark 3.0? Can not create the managed table. The associated location already exists.;
user_117420300
•
5
1
4713
spark3 spark-streaming apache-spark
How to control Spark Stream with stream of dynamic queries?
user_10052220
•
2
0
50
spark-streaming pyspark apache-spark-sql apache-spark
Spark on Yarn Number of Cores in EMR Cluster
user_21306360
•
3
0
403
spark-submit amazon-emr spark-streaming hadoop-yarn apache-spark
In Pyspark Structured Streaming, how can I discard already generated output before writing to Kafka?
user_63851050
•
2
0
67
spark-streaming spark-structured-streaming pyspark apache-spark
Spark dataframe output compression(gzip) with password protected
user_134909370
•
2
2
1822
spark-streaming hadoop2 apache-spark-sql apache-spark scala
Spark Stateful Structured Streaming: State getting too big in mapGroupsWithState
user_42180940
•
4
1
758
spark-streaming spark-structured-streaming apache-spark aggregate
How to get Last 1 hour data, every 5 minutes, without grouping?
user_9597880
•
3
1
1872
delta-lake spark-streaming spark-structured-streaming apache-spark-sql
Hot Questions