apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to alter ORC file's embedded schema?
user_27216980
•
1
1
260
orc hdfs apache-spark hadoop
Why planInputPartitions is called multiple times in a micro-batch?
user_28543640
•
3
0
120
apache-spark datasource
How can I control the amount of files being processed for each trigger in Spark Structured Streaming using the "Trigger once" trigger?
user_164308100
•
5
2
3186
spark-structured-streaming pyspark databricks apache-spark python
Spark: Why execution is carried by a master node but not worker nodes?
user_21591580
•
3
1
348
google-cloud-dataproc apache-spark scala
Spark Structured Streaming read different event types from kafka
user_112587880
•
1
0
61
spark-structured-streaming apache-kafka apache-spark scala
What is the best practice to load a delta table specific partition in databricks?
user_98857860
•
3
2
3094
delta-lake pyspark azure-databricks apache-spark partitioning
Spark, infer a separate schema for every JSON object in JSON array
user_92438460
•
1
0
152
apache-spark dataframe scala schema json
how to use spark to count continuous identical event?
user_12353720
•
1
1
100
apache-spark
Unable to write data in table by Apache Iceberg using Spark
user_51986470
•
2
1
1083
iceberg apache-spark-sql apache-spark
Create a DataFrame showing the other IDs that share the value of one column with each ID
user_45640800
•
1
2
86
pyspark apache-spark-sql apache-spark python
Hot Questions