apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Rewrite UDF to pandas udf with ArrayType column
user_1682310
•
2
1
315
pyspark pandas apache-spark user-defined-functions
Resource Manager UI on 8088 is not working while using kerberized Dataproc cluster
user_133852530
•
2
1
295
google-cloud-dataproc apache-spark kerberos hadoop
Applying Bucketizer to Spark dataframe after partitioning based on a column value
user_32846840
•
2
1
712
apache-spark-ml apache-spark-sql apache-spark scala
Spark Unnesting Nested Schema from DynamoDB Json
user_28433310
•
2
2
257
apache-spark-sql apache-spark
pyspark add multiple columns in grouped applyInPandas (change schema)
user_25879040
•
4
2
3143
pyspark pandas apache-spark group-by python
Run Object notebook in Databricks
user_144205810
•
2
0
485
databricks apache-spark scala
Spark catalog.clearCache and unpersisting RDD's
user_16714070
•
2
1
832
spring-boot apache-spark java
How to pass multiple environment variable for spark in cluster mode?
user_89715970
•
2
0
261
apache-spark scala
Spark DynamoDB Connectivity Issue
user_64290550
•
2
1
513
amazon-dynamodb apache-spark
SparkBQ connector issue: IllegalArgumentException: Wrong bucket: bq_temporary_folder, expected bucket: null
user_146659830
•
2
0
148
google-cloud-dataproc apache-spark google-bigquery
Hot Questions