apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to change all columns data types in StructType or ArrayType columns?
user_66456170
•
2
1
123
pyspark apache-spark-sql apache-spark dataframe scala
spark streaming watermark and explode error, file: .../state/0/0/1.delta does not exist
user_163717100
•
1
0
73
spark-streaming apache-spark hadoop amazon-s3 scala
Can run code in pyspark shell but the same code fails when submitted with spark-submit
user_80896950
•
2
1
338
spark-submit hadoop-yarn google-cloud-dataproc pyspark apache-spark
How to build a custom spark partitioner to avoid exchange / shuffle steps
user_5296180
•
2
0
174
pyspark databricks apache-spark partitioning
Remove specific stopwords Pyspark
user_113316910
•
1
1
1051
stop-words apache-spark-ml pyspark apache-spark python
How to modify pyspark dataframe nested struct column
user_97982230
•
4
1
1262
pyspark apache-spark-sql apache-spark dataframe struct
Spark Scala compiler not complaining about double vs. triple equals
user_8363180
•
3
1
47
apache-spark-sql apache-spark scala
how to put HashMap in BroadCast variable?
user_175640510
•
1
1
84
apache-spark java
pyspark when/otherwise clause failure when using udf
user_178634320
•
3
1
329
pyspark apache-spark-sql apache-spark user-defined-functions python
How to read all csv files that begin with consonant?
user_174699320
•
2
1
128
pyspark apache-spark-sql apache-spark
Hot Questions