apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Explode array values using PySpark
user_138346710
•
3
1
1297
pyspark apache-spark-sql apache-spark hadoop
Spark DataFrame add column from subquery
user_19962960
•
2
2
215
apache-spark-sql apache-spark
Pyspark collect list
user_88326410
•
3
2
2266
pyspark apache-spark dataframe
Pyspark: Replace all occurrences of a value with null in dataframe
user_60584990
•
5
4
1199
pyspark apache-spark-sql apache-spark
Aggregate values based upon conditions in pyspark
user_138346710
•
4
1
454
pyspark apache-spark-sql apache-spark hadoop
pyspark with pandas and pyarrow error on AWS EMR: 'JavaPackage' object is not callable
user_30338770
•
2
2
766
amazon-emr pyspark pyarrow pandas apache-spark
How to workaround this case of lateral join with Spark SQL?
user_3243150
•
3
0
482
lateral-join apache-spark-sql apache-spark
What does ":_*" mean in scala? (When using a List to filter a dataframe)
user_126450160
•
3
3
1698
apache-spark underscore.js dataframe list scala
How to write Spark UDF which takes Array[StructType], StructType as input and return Array[StructType]
user_93789850
•
2
2
2674
apache-spark user-defined-functions scala
Spark 3.0 is much slower to read json files than Spark 2.4
user_8106870
•
6
1
2071
spark3 java-11 apache-spark scala
Hot Questions