apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Stage in Persist has only 1 task running causing spill to disk
user_135417240
•
2
0
143
apache-spark-sql apache-spark
Why build.sbt Spark 3 application fat jar with dependencies is discarding the my dependencies?
user_20969860
•
2
1
1147
apache-spark sbt scala
Implementation of TextRank algorithm using Spark(Calculating cosine similarity matrix using spark)
user_139610200
•
2
1
405
textrank pyspark apache-spark nlp python
Optimizing Apache Spark on Kubernetes using custom plugins and the scheduling framework
user_44747170
•
2
1
285
apache-spark kubernetes scheduler plugins
Using pyspark, how to expand a column containing a variable map to new columns in a DataFrame while keeping other columns?
user_30411280
•
5
2
639
pyspark apache-spark-sql apache-spark
How to properly set variables for PySpark - Snowflake connection?
user_55786500
•
2
2
2906
snowflake-cloud-data-platform pyspark apache-spark scala
Cannot write dataframe into hive table after using UDF in Pyspark
user_92024200
•
2
0
215
pyspark apache-spark hive user-defined-functions numpy
How to submit multiple spark jobs to single AWS EMR cluster
user_40899000
•
8
1
2029
amazon-emr spark-streaming apache-spark java
None/== vs Null/isNull in Pyspark?
user_43056620
•
3
3
4372
pyspark apache-spark-sql apache-spark python
org.apache.spark.sql.AnalysisException: No such struct field
user_29809160
•
2
2
9290
apache-spark-sql apache-spark java
Hot Questions