apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark Cosmos db connector is dropping columns where majority of rows are null
user_84310970
•
3
1
329
azure-cosmosdb azure-databricks apache-spark azure
Spark: How do I write individual row to S3 / HDFS as JPG
user_60161750
•
3
1
263
amazon-emr pyspark apache-spark
Spark on Kubernetes - Failing to pass typesafe application.conf to driver and executor pods
user_38922800
•
2
0
116
typesafe typesafe-config apache-spark kubernetes java
How to do an incremental load/upsert in spark-redshift
user_154461150
•
2
0
165
amazon-redshift-spectrum delta-lake databricks apache-spark upsert
Why is spark dataframe repartition faster than coalesce when reducing number of partitions?
user_16112280
•
2
1
983
hdfs apache-spark
Spark Kubernetes - FileNotFoundException when copying config files from driver to executors using --files or spark.files
user_38922800
•
3
1
660
apache-spark kubernetes docker scala java
Is it possible to map out the dependencies between columns in PySpark?
user_38112900
•
3
0
89
pyspark apache-spark python
Delta table statistics
user_154520470
•
2
1
239
delta-lake pyspark apache-spark statistics logging
Loading Parquet Files with Different Column Ordering
user_32586000
•
2
0
137
parquet apache-spark
Spark saveAsTable append saves data to hive but throws an error: org.apache.hadoop.hive.ql.metadata.Hive.alterTable
user_76118380
•
1
2
685
pyspark apache-spark hive python
Hot Questions