apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Partitioning Hive Table
user_111572230
•
3
2
6271
hiveql apache-spark-sql apache-spark hive scala
All the executors are not being used when reading JSON(zipped .gz) in GCP from google dataproc spark cluster using spark-submit
user_25653850
•
4
2
1354
google-cloud-storage google-cloud-dataproc pyspark apache-spark json
Spark sampling options in JSON reader ignored?
user_753860
•
5
1
3253
pyspark apache-spark-sql apache-spark
Use Map to replace column values in Spark
user_54775310
•
12
2
14949
apache-spark-sql apache-spark scala
Serialization error with Spark Pandas_UDF
user_128503590
•
3
0
1114
pyspark apache-spark user-defined-functions serialization
Perform lookup on a broadcasted Map conditoned on column value in Spark using Scala
user_116320690
•
3
1
476
apache-spark-sql apache-spark scala
Does Spark Structured Streaming maintain the order of Kafka messages?
user_56751300
•
5
0
609
spark-structured-streaming apache-kafka apache-spark
Window Function Tie breaker on other field to get the Latest Record
user_70822210
•
5
2
1132
pyspark-sql pyspark apache-spark-sql apache-spark sql
JDBC to Spark Dataframe - How to ensure even partitioning?
user_19337680
•
7
2
7402
apache-spark-sql apache-spark partitioning jdbc
Dataproc arguments not being read on spark submit
user_46392680
•
3
1
1809
spark-submit google-cloud-dataproc gcloud apache-spark scala
Hot Questions