spark-structured-streaming

327 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Data source V2 streaming is not supported on table acl or credential passthrough clusters
user_33714680
•
1
1
16
spark-structured-streaming databricks
Spark Structured Streaming - stderr getting filled up
user_68431030
•
1
1
63
spark-structured-streaming google-cloud-dataproc pyspark apache-spark
How to get Databricks workspace Spark job logs via APIs or message queue
user_120945660
•
1
0
37
spark-structured-streaming azure-databricks databricks apache-spark
How to use "yarn application -stop "?
user_79675110
•
2
0
26
graceful-shutdown spark-structured-streaming hadoop-yarn
What is the best way to migrate delta tables created in spark streaming jobs to a new location?
user_199778230
•
4
0
87
delta-lake spark-structured-streaming pyspark apache-spark amazon-s3
Why is this JSON giving null values when I deserialize and try to extract values
user_196362230
•
1
1
32
spark-structured-streaming apache-kafka deserialization scala json
Spark Structured Streaming - unable to change max.poll.records (showing as 1)
user_68431030
•
1
0
39
spark-structured-streaming kafka-consumer-api pyspark apache-kafka apache-spark
How can I set the micro batch size in Spark Structured Streaming from Kafka topic?
user_193474420
•
1
1
28
batchsize checkpoint spark-structured-streaming pyspark
Databricks Autoloader is reading files from subfolders without explicitely asked to do so
user_162926060
•
1
0
60
databricks-autoloader spark-structured-streaming pyspark azure-databricks apache-spark
Inconsistent spark structured streaming behavior when using ProcessingTimeTimeout
user_198262880
•
3
0
100
spark-structured-streaming apache-spark scala
Hot Questions