apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Stream writes having multiple identical keys to delta lake
user_137696510
•
2
2
362
delta-lake spark-streaming apache-spark
Sequential execution of multiple spark jobs in dataproc / gcp
user_74793760
•
3
1
532
google-cloud-dataproc apache-spark google-cloud-platform
Hive table on delta lake
user_137696510
•
5
1
2468
delta-lake apache-spark hive
Build a hierarchy from a relational data-set using Pyspark
user_8138890
•
6
1
2336
graphframes pyspark apache-spark hierarchy python
The difference between similar spark configurations
user_56994020
•
8
0
490
hadoop-yarn apache-spark
Dependency issue with Pyspark running on Kubernetes using spark-on-k8s-operator
user_59625870
•
7
2
1893
pyspark apache-spark kubernetes docker dependency-management
PySpark remove special characters in all column names for all special characters
Admin1
•
6
4
13131
pyspark apache-spark-sql apache-spark str-replace special-characters
How to store Spark Streaming Checkpoint Location into S3?
user_14569620
•
2
1
1447
spark-checkpoint apache-spark-dataset spark-streaming spark-structured-streaming apache-spark
Equivalent SQL function of IFNULL and IFF in spark dataframe
user_90642400
•
2
1
1589
apache-spark-sql apache-spark dataframe sql
Why doesn't from_utc_timstamp throw an error when passed a malformed timezone string in Spark?
user_120172530
•
3
2
365
apache-spark scala
Hot Questions