apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Processing JSON containing nested entities using Spark Structured Streaming
user_18282960
•
4
1
1873
spark-structured-streaming apache-kafka apache-spark scala nested
Map[String,java.lang.Object] to DataFrame schema issue
user_31900180
•
4
1
845
apache-spark-sql apache-spark dataframe scala schema
pyspark error does not exist in the jvm error when initializing SparkContext
user_44065950
•
27
10
42666
amazon-emr pyspark apache-spark python-3.x python
Spark Catalyst flatMapGroupsWithState: Group State with sorted collection
user_19001690
•
3
0
595
spark-structured-streaming apache-spark scala
Group by column "grp" and compress DataFrame - (take last not null value for each column ordering by column "ord")
user_57412050
•
6
5
800
apache-spark aggregation aggregate-functions scala
What is the Parquet summary file?
user_97748120
•
3
3
1161
parquet apache-spark-sql apache-spark
java.lang.UnsupportedOperationException: Error in spark when writing
user_87998620
•
9
3
17226
apache-spark-dataset apache-spark
aws emr can't change default pyspark python on bootstrap
user_44065950
•
3
1
2054
amazon-emr pyspark apache-spark amazon-web-services python-3.x
Is there any preference on the order of select and filter in spark?
user_37688710
•
3
2
3954
pyspark apache-spark
SparkContext parallelize invocation example in java
user_56797280
•
3
2
2173
apache-spark java
Hot Questions