apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Reading Excel(xlsx) with Pyspark does not work above a certain medium size
user_38442700
•
1
2
118
pyspark azure-databricks databricks apache-spark-sql
How to enforce a specific partitioning and sort order automatically with a UDAF in Spark?
user_101094880
•
1
0
26
apache-spark-sql apache-spark partitioning user-defined-functions
pyspark : TypeError: element in array element in array element in array field prediction: ArrayType(FloatType,true) can not accept object
user_104970970
•
1
0
46
pyspark pandas apache-spark-sql apache-spark
Bucketize the pyspark dataframe rows into window duration of variable length based on values in a column
user_35410780
•
2
1
48
pyspark apache-spark-sql apache-spark sql
Spark Explode between 2 Dates
user_35126780
•
2
1
34
apache-spark-sql apache-spark
Using maven coordinates to load assemblies into synapse spark workspace
user_44555240
•
2
0
40
azure-synapse apache-spark-sql apache-spark
spark : sum values for same key from a json column while doing a group by based on id in spark dataframe
user_70545290
•
1
1
81
pyspark apache-spark-sql apache-spark
Spark filter dataframe on a condition based in the value on other rows
user_71500240
•
1
0
30
apache-spark-sql apache-spark
Spark dataframe distinct write is increasing the output size by almost 10 fold
user_51993210
•
1
1
96
apache-spark-sql apache-spark
How to stop Spark master on windows?
user_23987030
•
2
0
33
bigdata apache-spark-sql apache-spark windows
Hot Questions