apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to avoid excessive shuffles in join operation in pyspark?
user_53527480
•
4
2
1967
pyspark apache-spark-sql apache-spark python
Setting spark.driver.maxResultSize in EMR notebook jupyter
user_98656740
•
3
1
2319
spark-notebook amazon-emr jupyter-notebook apache-spark
Why clustering seems doesn't work in spark cogroup function
user_8507370
•
4
1
111
apache-spark scala
FileNotFoundException: Spark save fails. Cannot clear cache from Dataset[T] avro
user_14173800
•
2
2
1840
spark-avro apache-spark-dataset apache-spark-sql apache-spark caching
How to read JSON strings from CSV properlly with Pyspark?
user_54780360
•
3
2
1106
pyspark apache-spark python
Databricks spark_jar_task failed when submitted via API
user_47752180
•
2
1
704
databricks apache-spark rest api
How to submit PySpark job on Kubernetes (minikube) using spark-submit
user_59295710
•
2
2
932
pyspark apache-spark kubernetes amazon-s3
How to avoid multiple window functions in a expression in pyspark
user_46595300
•
4
1
1645
pyspark apache-spark python
UnsatisfiedLinkError while writing to S3 using Staging S3A Committer on Windows
user_78663770
•
2
2
2402
apache-spark-sql apache-spark hadoop amazon-s3 windows
How to insert a data frame which has a column array<array<double>> in Postgresql?
user_109069830
•
2
1
436
apache-spark postgresql scala arrays
Hot Questions