apache-spark

apache-spark

436 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Dynamically update a Spark dataframe column when used with lag and window functions
userr2QH0
•
1
1
30
lag window-functions dynamic pyspark apache-spark
How do I handle a null value in the a scala UDF?
Adarsh NamdevCHS0
•
0
1
36
user-defined-functions apache-spark scala
Efficient way to use forEachPartition in Apache Spark in Java
Kumar rajesh0
•
0
0
24
java apache-spark scala
how to use replaceWhere option with Apache iceberg while writing data
Leroy Mikenzi0
•
0
0
29
apache-iceberg iceberg apache-spark apache-spark-sql scala
Input path does not exist - and the job is getting failed due to this error, can some one help me out here
Rajasekhar Madduri0
•
-1
0
16
spark-jobserver hdfs etl hadoop apache-spark
StackOverflow Error while joining two Data frames
Ashit_Kumar0
•
2
0
37
spark-streaming apache-spark apache-spark-sql
Spark structured streaming best VMs
Vitali Dedkov0
•
0
1
11
databricks apache-spark
Create 1GB partitions Spark SQL
Michel Senra0
•
0
2
37
delta-lake delta pyspark apache-spark apache-spark-sql
AWS EMR set `mapred.reduce.tasks=1` merge small files
seunggabi0
•
0
0
14
apache-spark
Combine array columns to create an array of struct
HAEK0
•
0
1
23
struct dataframe pyspark apache-spark arrays
Hot Questions