apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to filter based on array value in PySpark?
user_52569680
•
17
2
48777
pyspark apache-spark-sql apache-spark dataframe python
Sum values of PairRDD
user_48023380
•
4
2
10970
apache-spark scala
Spark Is there any rule of thumb about the optimal number of partition of a RDD and its number of elements?
user_60451330
•
7
2
7821
apache-spark-sql apache-spark partitioning
SparkSQL function require type Decimal
user_60436150
•
4
1
16544
apache-spark-sql apache-spark scala types
How to parse a csv that uses ^A (i.e. \001) as the delimiter with spark-csv?
Admin1
•
15
2
34478
spark-csv apache-spark hive delimiter scala
Fuzzy text matching in Spark
user_14038400
•
3
0
1946
pyspark apache-spark
should I pre-install cran r packages on worker nodes when using sparkr
user_29775880
•
3
3
1878
sparkr apache-spark r
Merge multiple RDD generated in loop
user_44724570
•
5
2
4473
rdd apache-spark scala
Spark 1.6 apply function to column with dot in name/ How to properly escape colName
user_24942620
•
6
2
3261
apache-spark scala
Spark 1.6: drop column in DataFrame with escaped column names
user_24942620
•
14
2
54452
apache-spark scala
Hot Questions