apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to get the status of a Step in AWS EMR cluster?
user_40510900
•
3
1
2153
amazon-emr apache-spark aws-sdk amazon-web-services
Pyspark dataframe get a list of columns where at least one row meets a condition
user_26184610
•
3
1
1954
pyspark apache-spark dataframe python
How to fix 'DataFrame' object has no attribute 'coalesce'?
user_76158720
•
5
1
9827
pyspark apache-spark-sql apache-spark dataframe python
How to write multiple If statements in Spark UDF
user_85626480
•
3
1
8696
apache-spark-sql apache-spark
Writing Spark dataframe as parquet to S3 without creating a _temporary folder
user_1790140
•
5
2
23194
pyspark apache-spark hadoop amazon-s3
How can I evaluate the implicit feedback ALS algorithm for recommendations in Apache Spark?
user_45375530
•
8
2
6299
apache-spark-mllib apache-spark
Change Decimal Precision of all 'Double type' Columns in a Spark Dataframe
user_73904450
•
4
0
1119
spark-dataframe apache-spark-sql apache-spark scala
Spark Bucketizer - show all buckets even if there are no elements
user_66874730
•
3
1
1232
spark-dataframe apache-spark buckets scala
Spark - StorageLevel (DISK_ONLY vs MEMORY_AND_DISK) and Out of memory Java heap space
user_28073790
•
14
2
6502
rdd apache-spark memory caching scala
Spark Using Disk Resources When Memory is Available
user_8301590
•
3
1
2401
emr apache-spark-mllib hadoop-yarn apache-spark amazon-web-services
Hot Questions