apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Publish Apache Spark result to another Application/Kafka
user_25890300
•
3
2
838
apache-storm spark-streaming apache-kafka apache-spark
Spark saveAsTextFile to Azure Blob creates a blob instead of a text file
user_9245350
•
3
2
4019
azure-hdinsight azure-blob-storage apache-spark azure scala
Prevent DataFrame.partitionBy() from removing partitioned columns from schema
user_9944060
•
25
3
14183
spark-dataframe apache-spark
How to use Scala DataFrameReader option method
user_45211960
•
7
4
11229
apache-spark scala
Spark: cache RDD to be used in another job
user_12332350
•
4
2
1452
rdd apache-spark
PySpark: spit out single file when writing instead of multiple part files
user_23523190
•
9
3
16879
pyspark apache-spark-sql apache-spark amazon-s3 python
Spark Row to JSON
user_14604450
•
20
4
41387
apache-spark-sql apache-spark scala json
How to extend Spark Catalyst optimizer with custom rules?
user_27648580
•
4
2
2050
apache-spark-sql apache-spark
Spark mapWithState shuffles all data to one node
user_45053310
•
6
2
1163
spark-streaming apache-spark scala
Get a java.lang.LinkageError: ClassCastException when use spark sql hivesql on yarn
user_56860390
•
3
1
1606
apache-spark-sql apache-spark hive
Hot Questions