apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Calculate rolling sum of an array in PySpark using Window()?
user_122716760
•
2
2
1093
pyspark-dataframes pyspark apache-spark-sql apache-spark
Optimizing reading data to spark from Azure blob
user_26503560
•
2
2
662
apache-spark-2.3 azure-blob-storage apache-spark-sql apache-spark
Spark SQL (language, not API) and row data access from UDF
user_12197550
•
2
1
71
pyspark apache-spark-sql apache-spark user-defined-functions
No such file or directory error when running pyspark
user_38619650
•
4
1
9039
apache-spark
SparkSQL - Difference between two time stamps in minutes
user_101838700
•
7
1
22228
apache-spark-sql apache-spark sql
Location of WAL in Spark Structured Streaming
user_68892980
•
3
2
985
spark-streaming spark-structured-streaming apache-spark
Last Access Time Update in Hive metastore
user_32280000
•
5
1
674
pyspark apache-spark-sql apache-spark hive
flattening array of struct in pyspark
user_27730130
•
4
2
8344
pyspark apache-spark-sql apache-spark
Applying Python function to Pandas grouped DataFrame - what's the most efficient approach to speed up the computations?
user_73839710
•
12
3
1001
dask pandas apache-spark parallel-processing python
YARN + SPARK + Failed to replace a bad datanode on the existing pipeline due to no more good datanodes being available to try
user_118951460
•
3
0
2195
hdfs apache-spark
Hot Questions