apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to pass the parameter to User-Defined Function?
user_73168070
•
9
1
13826
pyspark apache-spark python
Mapping and removing duplicates in Spark Scala?
user_47466840
•
3
1
7035
apache-spark-sql apache-spark scala-collections scala
java.lang.IllegalArgumentException: Invalid lambda deserialization
user_89241620
•
5
2
2941
spark-streaming apache-kafka apache-spark java
Map in a spark dataframe
user_16920720
•
3
2
15586
apache-spark-sql apache-spark scala
Cannot load a saved Spark model in pyspark: "java.lang.NoSuchMethodException"
user_11203700
•
4
2
3564
pyspark apache-spark deserialization
Remove duplicates within Spark array column
user_88518870
•
8
4
5977
apache-spark-dataset apache-spark-sql apache-spark scala java
In what scenarios hash partitioning is preferred over range partitioning in Spark?
user_88992060
•
11
1
5409
rdd apache-spark partitioning performance
NoClassDefFoundError for org/spark_project/guava/cache/CacheLoader
user_15823500
•
4
3
6101
apache-spark scala
Spark yarn-client mode Python version
user_53975090
•
3
1
3822
hadoop-yarn pyspark apache-spark python-3.x
Calling scala code in pyspark for XSLT transformations
user_11963580
•
11
0
1016
pyspark apache-spark xslt scala
Hot Questions