apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Why does SparkContext.parallelize use memory of the driver?
user_86215270
•
3
3
1477
pyspark apache-spark
Spark 2.2.0 FileOutputCommitter
user_32791890
•
13
1
9517
amazon-emr apache-spark-sql apache-spark hadoop amazon-s3
Error when passing data from a Dataframe into an existing ML VectorIndexerModel
user_84287120
•
3
1
1981
apache-spark-ml pyspark apache-spark-sql apache-spark python
How to add external jar to Scala in Jupyter kernel
user_42545380
•
4
1
2324
apache-toree jupyter-notebook apache-spark scala
How can I obtain the DAG of an Apache Spark job without running it?
user_86190540
•
7
1
4183
apache-spark scala
How do implicit work in Spark/Scala
user_3289890
•
3
1
4106
apache-spark scala
Running several spark jobs concurrently from driver
user_38522700
•
4
1
1957
apache-spark
how can spark streaming rerun the failed batch job
user_86179740
•
3
0
318
spark-streaming apache-kafka apache-spark
spark-submit Error: No main class set in JAR; please specify one with --class
user_11650080
•
8
1
10933
apache-spark
Pyspark dataframe: how to apply scipy.optimize function by group
user_82487120
•
4
1
4546
pyspark apache-spark-sql apache-spark dataframe group-by
Hot Questions