apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to write a spark dataframe to S3 with MD5 header?
user_15214530
•
1
1
242
pyspark apache-spark amazon-s3
Pyspark adding additional double quotes in array at saving time
user_22651900
•
1
1
415
pyspark apache-spark json
Apache Spark 2.3.0 - How to merge two array<string> into one array<string>
user_59395990
•
1
1
279
spark-java apache-spark-sql apache-spark
Add minutes from another column to string time column in pyspark
user_88326410
•
3
2
483
pyspark apache-spark timestamp date python
Does Apache Spark 3 support GPU usage for Spark RDDs?
user_58485250
•
2
1
358
spark3 rapids rdd apache-spark gpu
How persist(StorageLevel.MEMORY_AND_DISK) works in Spark 3.1 with Java implementation
user_152605210
•
1
0
79
hadoop-yarn google-cloud-dataproc apache-spark-sql apache-spark hadoop
Why pushdown filters doesn't improve performance for spark parquet reading from S3
user_16508420
•
2
0
78
parquet apache-spark filter amazon-s3 python
Spark Dataframe with pivot and different aggregation, based on the column value (measure_type) - Scala
user_37539500
•
1
2
325
apache-spark-sql apache-spark aggregation scala
Writing Parquet in Azure Blob Storage: "One of the request inputs is not valid"
user_136726920
•
2
1
492
azure-blob-storage parquet apache-spark hadoop scala
Spark driver failed to start within 900 seconds
user_87186310
•
2
1
301
databricks apache-spark cloud azure
Hot Questions