apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How do I split a column by using delimiters from another column in Spark/Scala
user_93541660
•
5
4
692
apache-spark-sql apache-spark scala
Spark skewedPartitionThresholdInBytes not getting enforced
user_78735700
•
2
0
103
skew pyspark apache-spark-sql apache-spark query-optimization
pyspark transform json array into multiple columns
user_90903400
•
1
1
661
pyspark apache-spark-sql apache-spark python-3.x
Adding data to scala WrappedArray in Java
user_33116160
•
1
1
194
apache-spark-sql apache-spark scala java
Databricks: Incompatible format detected (temp view)
user_49040270
•
2
1
2267
parquet pyspark databricks apache-spark-sql apache-spark
Does writing pyspak sql dataframe to disk and reading again speed up the further processing?
user_38846070
•
1
1
92
pyspark apache-spark-sql
Unable to write data in table by Apache Iceberg using Spark
user_51986470
•
2
1
1083
iceberg apache-spark-sql apache-spark
Create a DataFrame showing the other IDs that share the value of one column with each ID
user_45640800
•
1
2
86
pyspark apache-spark-sql apache-spark python
Is it possible to cast multiple columns of a dataframe in pyspark?
user_160533700
•
4
1
1046
pyspark apache-spark-sql apache-spark python
Find difference of column value in spark using scala
user_78122730
•
1
2
147
apache-spark-sql apache-spark scala
Hot Questions