apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to run 2 EMR Spark Step Concurrently?
user_22927910
•
7
5
7718
amazon-emr hadoop-yarn apache-spark
Spark launcher handle not updating state on Standalone cluster mode
user_106034250
•
4
0
348
spark-launcher apache-spark-standalone apache-spark cluster-computing
Can't get a SparkContext in new AWS EMR Cluster
user_106034220
•
16
3
7047
amazon-emr pyspark apache-spark amazon-web-services
Extract and Visualize Model Trees from Sparklyr
user_47212560
•
5
1
995
sparklyr apache-spark decision-tree random-forest r
Spark - Reading many small parquet files gets status of each file before hand
user_4351820
•
9
1
1743
parquet apache-spark-sql apache-spark amazon-s3 scala
pyspark.sql.utils.AnalysisException: u'Unable to infer schema for Parquet. It must be specified manually.;'
user_14327920
•
4
2
13051
parquet pyspark apache-spark
Python equivalent to Spark rangeBetween for window?
user_13086670
•
4
1
179
pyspark apache-spark python
How to train a neural network autoencoder (Keras) on Spark dataframe
user_42302340
•
4
1
1888
systemml autoencoder pyspark keras apache-spark
Spark Structured Streaming watermark error
user_7411640
•
4
2
1441
spark-streaming apache-spark-sql apache-spark
Speed up InMemoryFileIndex for Spark SQL job with large number of input files
user_10521580
•
7
1
4807
apache-spark-sql apache-spark
Hot Questions