apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark parquet schema evolution
user_62916910
•
2
2
1515
parquet apache-spark
PySpark to_utc_timestamp return the same time
user_46929370
•
2
1
5179
pyspark apache-spark hive timezone timestamp
How to Run a spark job in cluster mode in GCP?
user_46379890
•
2
2
1611
google-cloud-dataproc apache-spark google-cloud-platform
Spark - Merge / Union DataFrame with Different Schema (column names and sequence) to a DataFrame with Master common schema
user_127989370
•
2
1
3015
pyspark apache-spark python
parquet int96 timestamp conversion to datetime/date via python
user_25353070
•
3
2
5913
parquet apache-spark timestamp casting python
How to create an Estimator that trains new samples after already fitted to initial dataset?
user_77995870
•
2
3
187
apache-spark-mllib apache-spark machine-learning scala
spark structured Streaming is not working with kafka log compaction topic
user_130624760
•
2
0
200
spark-structured-streaming apache-kafka apache-spark
How does spark-submit.sh work with different modes and different cluster managers?
user_1564580
•
3
1
567
apache-spark cluster-computing
Spark: AWSClientIOException in XmlResponsesSaxParser ListBucketHandler while writing parquet to S3
user_44174490
•
2
1
1059
spark-streaming apache-spark amazon-web-services amazon-s3
What happen if I use reduceByKey or groupByKey one large datasets having only two keys
user_65791160
•
2
1
321
rdd pyspark apache-spark
Hot Questions