apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Add integer in repeating N rows based on a condition
user_139124140
•
1
1
71
pyspark apache-spark-sql apache-spark dataframe
pyspark high performance rolling/window aggregations on timeseries data
user_42634860
•
3
2
3376
rolling-computation pyspark apache-spark-sql apache-spark window-functions
Is there an idiomatic way to cache Spark dataframes?
user_50131330
•
3
2
503
pyspark apache-spark-sql apache-spark dataframe
Why "collect" action in spark triggers data collection to driver?
user_52569830
•
1
1
350
rdd pyspark apache-spark-sql apache-spark hadoop
How to unpack list of lists that are in string format?
user_14007240
•
2
3
649
pyspark apache-spark-sql apache-spark python
Pyspark: adding a new column to dataframe based on the values in another dataframe using an udf
user_106802340
•
3
1
219
pyspark apache-spark-sql apache-spark python
Remove a list from a list of lists in PySpark DataFrame
user_45849090
•
2
1
225
pyspark apache-spark-sql apache-spark python
Convert array of JSON objects to string in pyspark
user_135963240
•
3
1
975
pyspark apache-spark-sql apache-spark json
How to yield pandas dataframe rows to spark dataframe
user_95798210
•
2
2
2769
pyspark pandas apache-spark-sql apache-spark user-defined-functions
Write a spark DataFrame to a table
user_13040530
•
2
2
163
apache-spark-sql apache-spark hive
Hot Questions