apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How can we have different driver and executor for Spark on Kubernetes on Azure?
user_104545620
•
3
1
284
azure-aks kubernetes-pod kubernetes-helm apache-spark kubernetes
pyspark - calculation of partitioned data (created with "append" mode) slow
user_80446520
•
2
1
192
pyspark apache-spark partitioning
Spark 2.3 timestamp subtract milliseconds
user_42191620
•
2
1
452
apache-spark milliseconds timestamp
What might cause a connection issue with Spark external shuffle service?
user_14373460
•
2
1
834
google-cloud-dataproc apache-spark shuffle
Spark DataFrames Scala - jump to next group during a loop
user_83108980
•
3
1
115
apache-spark grouping scala loops
How to Store Failed Status Records of Amazon Deequ in a Separate Spark DataFrame
user_165607840
•
2
1
541
amazon-deequ apache-spark scala
Databricks secret visible in cleartext
user_58334160
•
3
0
629
azure-keyvault azure-databricks databricks apache-spark azure
UDF function taking much time
user_135902170
•
2
1
243
pyspark apache-spark python
Adding a nullable column in Spark dataframe
user_27535010
•
3
1
1431
pyspark apache-spark-sql apache-spark nullable python
spring boot with spark-submit cluster mode
user_22285250
•
3
0
186
spring-boot apache-spark-sql apache-spark spring
Hot Questions