apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to sum every N rows over a Window in Pyspark?
user_146151500
•
2
2
1053
pyspark apache-spark-sql apache-spark window-functions
Read from glue cataloge using spark and not using dynamic frame(glue context)
user_88662790
•
3
1
3809
aws-glue-data-catalog aws-glue-spark aws-glue apache-spark amazon-web-services
How to get custom log4j.properties to take effect for Spark driver and executor on AWS EMR cluster?
user_12243630
•
2
1
492
amazon-emr apache-spark amazon-web-services log4j
pyspark - Convert column string to header and values
user_120269490
•
2
2
418
pyspark apache-spark-sql apache-spark
filter rows for column value in list of words pyspark
user_112551390
•
2
1
206
pyspark apache-spark python
Improve Pandas UDF in Pyspark
user_139124140
•
2
1
609
pyspark apache-spark user-defined-functions windows performance
How to calculate time between events in a group
user_115098790
•
2
1
221
bigdata spark-streaming spark-structured-streaming pyspark apache-spark
How to create table with nested map on databricks using sql
user_120041510
•
3
1
696
databricks apache-spark-sql apache-spark arrays sql
Google data proc logs error about insufficient resources but not failing
user_26185030
•
4
1
174
google-cloud-dataproc apache-spark google-cloud-platform
How to decrease total timing processing of Spark SQL Execution plan
user_101164660
•
2
1
436
pyspark databricks apache-spark-sql apache-spark sql-execution-plan
Hot Questions