apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to add/mutate a Map object in MutableAggregationBuffer in UDAF?
user_80987480
•
2
2
1885
apache-spark-sql apache-spark scala
Spark 2.1 Hive Partition Adding Issue ORC Format
user_32266300
•
2
1
2052
pyspark-sql orc pyspark apache-spark hive
How to convert map column to struct type with custom key-value names?
user_68379470
•
3
2
2029
apache-spark-sql apache-spark struct scala dictionary
Difference between spark-submit vs. SparkSession in python script?
user_3146310
•
9
1
2661
pyspark apache-spark
Check if arraytype column contains null
user_20729780
•
7
3
6532
apache-spark-sql apache-spark dataframe null scala
How to deal with slow executor in spark streaming?
user_65884390
•
3
0
252
spark-streaming apache-spark
What is the naming convention for YARN containers used by Spark?
user_4163000
•
3
2
1533
hadoop-yarn apache-spark naming-conventions
DataFrame.count() == 0 Vs DataFrame.rdd.isEmpty(): Which is better and why?
user_51339050
•
2
2
3821
apache-spark-sql apache-spark scala
Column features must be of type org.apache.spark.ml.linalg.VectorUDT
user_80964020
•
6
1
9191
pyspark apache-spark import
How to write rows asynchronously in Spark Streaming application to speed up batch execution?
user_64772840
•
5
2
3905
spark-streaming apache-spark-sql apache-spark performance
Hot Questions