apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
java.sql.SQLException -> NumberFormatException when using .show() method on DataFrame in spark
user_100116840
•
3
1
337
apache-spark hive jdbc scala
Writing a nested dataframe to JSON file removes camelcase on attributes
user_141887120
•
3
0
90
apache-spark-sql apache-spark dataframe scala json
Is it possible to register a DataFrame API function for use in a SQL expression?
user_47842450
•
3
0
69
pyspark apache-spark-sql apache-spark
More than 1 column in record key in spark Hudi Job while making an upsert
user_31992850
•
2
2
2017
apache-hudi apache-spark-sql apache-spark
how to use foreachBatch.batchDF.unpersist() appropriately in structured streaming? (keep got an error)
user_141852590
•
3
1
1179
spark-structured-streaming apache-spark compiler-errors caching
Spark number of tasks vs number of partitions
user_94452880
•
2
0
116
pyspark apache-spark-sql apache-spark
how to improve performance in pyspark joins
user_131267940
•
2
1
101
pyspark apache-spark-sql apache-spark python
Unable to write CSV file to Azure Blob Storage using Pyspark
user_141701520
•
2
0
296
azure-blob-storage pyspark apache-spark azure
Assert RDD is not sorted
user_10262710
•
4
1
114
apache-spark scalatest scala unit-testing
GraphFrames: Merge edge nodes with similar column values
user_3097060
•
5
1
908
graphframes pyspark apache-spark hadoop graph
Hot Questions