spark-structured-streaming

327 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Is there a monitoring endpoint for Spark Structured streaming?
user_12861370
•
3
0
120
azure-synapse spark-structured-streaming databricks apache-spark
How to get Kafka header's value to Spark Dataset as a single column?
user_17590630
•
2
1
746
spark-structured-streaming apache-kafka apache-spark scala
How can I read every 5 seconds in pyspark with kafka readStream?
user_36728830
•
1
1
262
spark-structured-streaming pyspark apache-kafka apache-spark
Structured Streaming runs out of memory after running for a while even with spark.catalog.clearCache()
user_126447550
•
1
0
252
spark-structured-streaming pyspark apache-kafka apache-spark
Spark Structured Streaming, scala - Azure data lake - files created empty BEFORE being populated
user_43856440
•
1
0
43
azure-data-lake-gen2 spark-structured-streaming apache-spark scala
Mapping Kafka to Spark dataFrame with the Schema
user_142934860
•
2
0
170
spark-structured-streaming apache-kafka apache-spark-sql apache-spark
Structured Streaming with Apache Spark coded in Spark.SQL
user_155206150
•
2
1
256
spark-structured-streaming pyspark azure-databricks databricks apache-spark
How to see a particular metric in Spark Structured Streaming with Python
user_143671200
•
2
2
278
spark-structured-streaming pyspark apache-spark python
Increasing CPU and memory usage in a Spark Structured Streaming application
user_171597860
•
2
0
122
amazon-emr spark-structured-streaming apache-kafka apache-spark memory-leaks
Spark Structured Streaming program that reads from non-empty Kafka topic (starting from earliest) triggers batches locally, but not on EMR cluster
user_12243630
•
5
2
400
amazon-emr spark-structured-streaming apache-kafka apache-spark
Hot Questions