spark-structured-streaming

327 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
how to use foreachBatch.batchDF.unpersist() appropriately in structured streaming? (keep got an error)
user_141852590
•
3
1
1179
spark-structured-streaming apache-spark compiler-errors caching
How to get Last 1 hour data, every 5 minutes, without grouping?
user_9597880
•
3
1
1872
delta-lake spark-streaming spark-structured-streaming apache-spark-sql
MicroBatchExecution: Query terminated with error UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
user_141174780
•
2
1
1342
spark-streaming-kafka spark-structured-streaming apache-spark-sql apache-spark java
I don't understand why there isn't any save or append data operation at the last stage
user_120788260
•
2
1
91
spark-structured-streaming spark-cassandra-connector apache-spark-sql apache-spark cassandra
Spark Streaming Dataset Cassandra Connection UnsupportedOperationChecker
user_130908090
•
2
1
193
spark-structured-streaming spark-cassandra-connector apache-spark cassandra
How to get the count of number of records in structured streaming?
user_134998730
•
2
0
135
spark-streaming spark-structured-streaming apache-spark scala
How do I do functions.from_csv at spark structured stream
user_140609600
•
2
1
685
spark-structured-streaming apache-kafka apache-spark scala
SparkSession initilization throws ExceptionInInitializerError
user_134109780
•
3
1
834
spark-streaming spark-structured-streaming apache-spark maven java
Querying Delta Lake from Inside of UDF in Databricks
user_118874920
•
2
1
703
delta-lake spark-structured-streaming databricks apache-spark user-defined-functions
Structured Streaming vs Batch Performance differences
user_2352750
•
3
1
904
spark-structured-streaming azure-databricks apache-spark
Hot Questions