apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to emulate the array_join() method in spark 2.2
user_107580510
•
2
1
352
apache-spark-sql apache-spark scala
SPARK SQL throws AssertionError: assertion failed: Found duplicate rewrite attributes (Spark 3.0.2)
user_7597380
•
2
0
1233
spark3 apache-spark-sql apache-spark
Parquet compression degradation when upgrading spark
user_22042060
•
5
1
207
snappy parquet apache-spark-sql apache-spark
Spark- write 128 MB size parquet files
user_87614460
•
3
2
2912
apache-spark-sql apache-spark dataframe scala
Why does Spark perform an unnecessary shuffle during a joinWith on a pre-partitioned dataframe?
user_14373460
•
3
1
63
apache-spark-sql apache-spark
Indexes for Databricks (Spark SQL) tables
user_108869360
•
4
1
2902
delta-lake databricks apache-spark-sql indexing
Databricks Spark Dataframe - mismatching schemas - controlling the errors
user_33658860
•
2
0
422
pyspark databricks apache-spark-sql apache-spark
How do I update a large SQL table using pyspark?
user_157849150
•
2
0
1431
pyspark databricks apache-spark-sql apache-spark
pyspark how to check if given spark dataframe has created with inferSchema=True
user_98506360
•
2
2
485
pyspark apache-spark-sql
Counting longest sequence of specific elements in a list contained within a spark.sql database column
Admin1
•
2
2
196
apache-spark-sql apache-spark scala sql
Hot Questions