apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Distinguish between null and missing field when reading json into pyspark dataframe
user_111935540
•
2
0
20
pyspark apache-spark dataframe null json
Remove duplicates from PySpark array column by checking each element
user_119729340
•
2
2
89
pyspark apache-spark-sql apache-spark duplicates arrays
ClassCastException while running Spark Spring boot app on Dataproc
user_122773520
•
2
0
43
google-cloud-dataproc spring-boot apache-spark scala java
Spark expecting HDFS location instead of Local Dir
user_112891610
•
1
1
53
spark-structured-streaming pyspark apache-spark
Unable to share across dataframe in same notebook
user_102737220
•
2
1
69
pyspark azure-databricks databricks apache-spark
How to add the new columns based on counts identified by conditions applied to multiple columns in Pyspark?
user_163636300
•
1
1
30
pyspark apache-spark-sql apache-spark
Calculating SHAP values with PySpark
user_2700430
•
1
1
142
shap pyspark pandas apache-spark python
scala rapids using an opaque UDF for a single column dataframe that produces another column
user_9269180
•
1
1
55
rapids apache-spark-sql apache-spark gpu scala
How to reset the row number to 1 on a non consecutive record
user_64587070
•
2
1
76
hiveql apache-spark-sql apache-spark hive sql
Java error for installation rasterframes (databricks)
user_74088750
•
1
1
83
rasterframes databricks apache-spark-sql apache-spark geospatial
Hot Questions