apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
In spark, can I use full outer join with shuffle hash join strategy? If no, then why?
user_109442530
•
2
1
114
apache-spark-sql apache-spark
Calculate cumulative sum of pyspark array column
user_88445850
•
3
1
476
pyspark apache-spark-sql apache-spark
Creating a custom counter in Spark based on dataframe conditions
user_75702590
•
4
2
251
pyspark apache-spark-sql apache-spark user-defined-functions
Creating a new column in pyspark dataframe using another column values from future
user_160935650
•
2
2
334
pyspark apache-spark-sql apache-spark
Change the datatype of a column in delta table
user_123358380
•
3
2
4796
delta-lake apache-spark-sql apache-spark
Controlling Decimal Precision Overflow in Spark
user_59278430
•
3
1
990
apache-spark-sql apache-spark decimal
Spark read csv - multiple S3 paths in Java
user_160467680
•
2
1
104
apache-spark-sql apache-spark hadoop java
Why broadcast join collect data to driver in order to shuffle data?
user_152850050
•
4
1
480
pyspark apache-spark-sql apache-spark join
PySpark - Fill in null values in a Struct column
user_75203090
•
2
1
1143
pyspark apache-spark-sql apache-spark python
Scala Spark functions like group by, describe() returning incorrect result
user_153458260
•
1
1
142
apache-spark-sql apache-spark scala
Hot Questions