apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to calculate rowwise median in a Spark DataFrame
user_71266660
•
3
4
1870
pyspark apache-spark-sql apache-spark
How to access nested schema column?
user_99508940
•
3
2
517
spark-structured-streaming apache-spark-sql apache-spark
How to add a column to a PySpark dataframe which contains the nth quantile of another column in the dataframe
user_23565630
•
3
1
288
quantile pyspark apache-spark-sql apache-spark percentile
How to convert spark rdd to a numpy array?
user_103608450
•
2
3
6065
pyspark apache-spark numpy python
Spark - How to add an element to an array of structs
user_79008530
•
4
2
6369
apache-spark-sql apache-spark dataframe struct arrays
My SparkSession initialization takes forever to run on my laptop. Does anybody have any idea why?
user_109130050
•
3
0
1221
pyspark apache-spark
Remove duplicates from PySpark array column
user_46299500
•
2
1
10872
pyspark apache-spark-sql apache-spark python
How to solve this error "Type mismatch: cannot convert from List<String> to Iterator<String>"
user_99071850
•
3
2
3423
java-8 apache-spark java
When running Spark on Kubernetes to access kerberized Hadoop cluster, how do you resolve a "SIMPLE authentication is not enabled" error on executors?
user_109111800
•
4
4
4882
openshift apache-spark kubernetes docker kerberos
Elegant way to fillna missing values for dates in spark
user_83292130
•
7
1
6999
fillna apache-spark date python
Hot Questions