apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Exception : Task failed while writing rows
user_26062550
•
10
5
35720
parquet apache-spark-sql apache-spark hadoop java
Building a StructType from a dataframe in pyspark
user_54941680
•
19
3
72952
pyspark apache-spark-sql apache-spark dataframe python
How do I pass program-argument to main function in running spark-submit with a JAR?
user_20760460
•
24
4
63880
apache-spark java
How to use a Scala class inside Pyspark
user_16897060
•
25
2
19140
pyspark apache-spark-sql apache-spark scala python
How to split an RDD into many in Spark?
user_1386060
•
4
2
5865
apache-spark java
In PySpark, how can I log to log4j from inside a transformation
user_15073930
•
10
2
2930
pyspark apache-spark
Apache Spark: Apply existing mllib model on Incoming DStreams/DataFrames
user_42970300
•
3
1
483
apache-spark-mllib apache-spark machine-learning hadoop
Pyspark : forward fill with last observation for a DataFrame
user_38297360
•
19
5
23760
pyspark apache-spark-sql apache-spark
How to prevent the same Spark app execution twice
user_35968960
•
3
0
376
pyspark apache-spark python
Replacing whitespace in all column names in spark Dataframe
user_38462910
•
11
7
29240
apache-spark-sql apache-spark scala
Hot Questions