apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Load only struct from map's value from an avro file into a Spark Dataframe
user_71549140
•
1
1
93
pyspark apache-spark-sql apache-spark struct dictionary
How to create dataframe with struct column in PySpark without specifying a schema?
user_25403360
•
1
1
1096
pyspark-schema pyspark apache-spark-sql apache-spark struct
How bucketing can improve join performance
user_189990230
•
1
1
78
pyspark apache-spark-sql
PySpark: how to performs conditional calculation on each element of a long string
user_182714170
•
1
1
67
pyspark-pandas pyspark apache-spark-sql
Converting PySpark's consecutive withColumn to SQL
user_135685130
•
1
2
92
pyspark apache-spark-sql apache-spark datediff unix-timestamp
Extract value from array in Spark
user_126256790
•
1
1
79
apache-spark-sql apache-spark scala arrays json
Update a highly nested column from string to struct
user_65857350
•
2
2
99
pyspark-schema pyspark apache-spark-sql apache-spark scala
Spark - Update a nested column to string
user_65857350
•
2
2
215
pyspark apache-spark-sql apache-spark scala
Azure Databricks INFORMATION_Schema
user_16843150
•
1
1
486
azure-databricks databricks apache-spark-sql information-schema
UDF lookup mapping a pyspark dataframe column
user_116457190
•
4
2
401
pyspark databricks apache-spark-sql apache-spark
Hot Questions