apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Explode multiple columns from nested JSON but it is giving extra records
user_145343490
•
1
1
596
pyspark apache-spark-sql apache-spark nested json
Pyspark: How to check whether a file path with wild character exists in s3
user_119419020
•
2
1
518
pyspark apache-spark amazon-web-services amazon-s3
Changing Spark UI dashboard host and port on SparkContext config (SparkConf)
user_130600470
•
2
1
84
pyspark apache-spark python
Pass custom command line arguments to jar via pyspark (rewriting spark-submit call to pyspark)
user_86507840
•
1
0
196
pyspark apache-spark
Error: Stopping Service [Tomcat] Due to Spark
user_142934860
•
1
1
110
spring-boot apache-spark spring java
SparkContext: Error initializing SparkContext while Running Spark Job via google DataProc
user_117516660
•
3
2
240
google-cloud-dataproc apache-spark numberformatexception
PySpark Window using rangeBetween and rowsBetween together
user_168324330
•
1
1
624
pyspark apache-spark-sql apache-spark dataframe window-functions
Why is union() a narrow transformation and intersection() is a wide transformation in spark?
user_70563680
•
1
2
1222
rdd pyspark apache-spark transformation scala
Get max value of multiple group by in PySpark
user_61299450
•
1
2
691
pyspark apache-spark-sql apache-spark python
TypeError: Column is not iterable
user_61877920
•
1
1
1297
pyspark apache-spark-sql apache-spark python
Hot Questions