apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to extract the elements of an Array[String] that starts with particular value in Scala?
user_112049730
•
3
3
1613
apache-spark scala
Scala println() in zeppelin paragraph doesn't print while regular print() prints well
user_115992400
•
4
1
845
apache-zeppelin apache-spark scala
Need to set values in columns of dataset based on value of 1 column
user_31829420
•
5
2
205
apache-spark-dataset apache-spark java
Iterative spark with caching runs out of memory
user_23287340
•
3
0
678
checkpoint apache-spark out-of-memory caching
Why is the "topics" argument of KafkaUtils.createStream() a Map rather then array?
user_10262710
•
4
3
175
spark-streaming apache-kafka apache-spark java
How can I use graphframes with pyspark on AWS EMR?
user_84853630
•
5
3
1558
graphframes amazon-emr jupyter-notebook pyspark apache-spark
SparkAppHandle State is LOST after submit, but the driver runs flawlessly
user_50145720
•
3
1
678
apache-spark java
how to get first value and last value from dataframe column in pyspark?
user_47466840
•
4
3
22636
pyspark apache-spark-sql apache-spark
Does distinct() sort the dataset?
user_95230840
•
4
1
1671
apache-spark scala
Spark Structured Streaming - UI Storage Memory value growing
user_78514860
•
5
0
554
spark-structured-streaming apache-spark
Hot Questions