apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark: Why does Python significantly outperform Scala in my use case?
user_58175390
•
17
2
2733
pyspark apache-spark scala python
spark-submit classNotFoundException : Unable to read from s3 in EMR
user_80540040
•
4
0
443
amazon-emr apache-spark hadoop scala java
Spark aggregations where output columns are functions and rows are columns
user_128751610
•
3
2
776
pyspark-sql pyspark-dataframes pyspark apache-spark python
Is it possible to run a Spark Scala script without going inside spark-shell?
user_7608070
•
5
2
1921
spark-shell apache-spark scala
Extracting all matches from different pyspark columns depending on some condition
user_59131020
•
4
3
1719
pyspark apache-spark user-defined-functions python regex
how to update spark dataframe column containing array using udf
user_41651180
•
3
3
1217
apache-spark-sql apache-spark user-defined-functions scala
Creating a new column using complex conditionals and lagged self references in Spark
user_16612120
•
2
1
637
pyspark apache-spark
Spark Job - Scala Objects are read in FIFO order, How to make it parallel?
user_12458870
•
2
1
116
apache-spark scala
How can I group and get the median num in Spark Dataframe
user_119543870
•
2
2
109
apache-spark-sql apache-spark dataframe
How can you efficiently build one ML model per partition in Spark with foreachPartition?
user_75233640
•
3
1
671
apache-spark-ml apache-spark scala
Hot Questions