apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Sparklyr's spark_apply function seems to run on single executor and fails on moderately-large dataset
user_52906030
•
3
1
1632
sparklyr apache-spark r
reuse the result of a select expression in the "GROUP BY" clause?
user_11680410
•
5
2
1283
apache-spark-sql apache-spark scala mysql
scala.MatchError: [abc,cde,null,3] (of class org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema) in Spark JSON with missing fields
user_22117210
•
4
1
2140
apache-spark nullpointerexception pattern-matching scala json
Setting spark.speculation in Spark 2.1.0 while writing to s3
user_8609910
•
8
1
3651
apache-spark amazon-s3
Livy is failing when a job is submitted in yarn cluster mode
user_50432690
•
3
0
1295
livy hadoop-yarn apache-spark
How can I run ScalaTest suites in a single thread?
user_728600
•
3
1
1200
apache-spark scalatest gradle scala
Union in Spark SQL query removing duplicates from Dataset
user_21099570
•
4
1
5999
apache-spark-sql apache-spark
Apache Spark subtract days from timestamp column
user_68296550
•
7
2
12310
apache-spark-sql apache-spark dataframe timestamp
Spark and Elastic causing jackson overlap
user_46488730
•
3
1
111
elasticsearch apache-spark jackson classpath java
Spark 2.2 structured streaming reading from Kafka topic only one executor reading from partitions
user_67577170
•
3
0
200
spark-structured-streaming apache-spark
Hot Questions