apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Daily forecast on a PySpark dataframe
user_116985620
•
2
1
118
pyspark apache-spark-sql apache-spark window-functions sql
Sort by key in map type column for each row in spark dataframe
user_32846840
•
2
1
1959
pyspark apache-spark-sql apache-spark dictionary
Spark partition projection/pushdown and schema inference with partitioned JSON
user_40687550
•
4
2
295
pyspark apache-spark-sql apache-spark json
PySpark Sum fields that are imbedded in a array within an array
user_4229300
•
1
1
93
pyspark apache-spark-sql apache-spark arrays python
How spark calculates the window start time with given window interval?
user_119345020
•
1
1
469
spark-checkpoint spark-streaming-kafka spark-structured-streaming apache-spark-sql apache-spark
Spark Dataset show: Unable to Capture Output Multiple Times
user_114482130
•
1
1
89
apache-spark-dataset apache-spark-sql apache-spark java
Extract regex that matches dataframe value
user_131924860
•
1
2
205
pyspark apache-spark-sql apache-spark python
Conditionally fill NA based on aggregation of corresponding column values
user_81459710
•
1
1
51
pyspark apache-spark-sql apache-spark python
Pyspark One Hot Encoding
user_107263860
•
1
2
393
pyspark apache-spark-sql apache-spark
Spark 3.0 UTC to AKST conversion fails with ZoneRulesException: Unknown time-zone ID
user_83245180
•
2
2
589
apache-spark-sql apache-spark
Hot Questions