apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How do I delete files in hdfs directory after reading it using scala?
user_11258290
•
12
2
29529
spark-streaming apache-spark hadoop scala
java.lang.NoSuchMethodError: org.apache.spark.sql.DataFrameReader.load
user_67988620
•
3
0
2786
apache-spark-sql apache-spark scala
Spark Streaming Scala combine json of different structure to form a DataFrame
user_83070630
•
3
2
2911
apache-spark scala json
PySpark: TypeError: StructType can not accept object 0.10000000000000001 in type <type 'numpy.float64'>
user_36569120
•
3
1
11243
pyspark apache-spark-sql apache-spark numpy python
Error Code: JA018 whie runnnig oozie workflow in HDInsight spark2 cluster
user_61808300
•
4
1
5387
oozie-coordinator oozie azure-hdinsight apache-spark azure
How to display a streaming DataFrame (as show fails with AnalysisException)?
user_23611740
•
7
2
16945
spark-structured-streaming pyspark apache-kafka apache-spark
Spark giving Null Pointer Exception while performing jdbc save
user_16331120
•
3
1
1679
spark-dataframe apache-spark-sql apache-spark sql-server
How to split comma separated string and get n values in Spark Scala dataframe?
user_16485450
•
7
2
4263
spark-dataframe apache-spark-sql apache-spark dataframe scala
Spark Streaming: Micro batches Parallel Execution
user_14124710
•
12
4
7974
spark-streaming apache-kafka apache-spark hadoop
Spark Java encoders - switch fields on collectAsList
user_14819860
•
3
1
851
apache-spark-sql apache-spark java
Hot Questions