apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark how to create a column based on rows values
user_145379810
•
2
2
106
pyspark apache-spark-sql
Spark explode array of string to columns
user_106669910
•
9
3
2234
pyspark apache-spark-sql apache-spark arrays java
Spark: write Paquet from heterogeneous data
user_9985230
•
2
2
157
bigdata parquet apache-spark-sql apache-spark scala
Filter array values during aggregation in spark dataframe
user_101616850
•
2
1
330
pyspark apache-spark-sql apache-spark scala-collections scala
Why joining structure-identic dataframes gives different results?
user_27535010
•
7
2
534
pyspark apache-spark-sql apache-spark join
How can I write dataframe to csv file using one partition although the file size exceeds executors memory
user_150705590
•
2
1
325
apache-spark-sql apache-spark hadoop jvm scala
Spark "first" Window function is taking much longer than "last"
user_5296180
•
7
1
511
pyspark apache-spark-sql apache-spark window-functions performance
Pyspark : TypeError: unsupported operand type(s) for +: 'int' and 'str'
user_151130290
•
2
1
837
pyspark apache-spark-sql
Apache Spark What happens when repartition($"key") is called when size of all records per key is greater than the size of a single partition?
user_74694090
•
2
2
262
apache-spark-sql-repartition apache-spark-sql apache-spark scala
PySpark / Spark SQL DataFrame - Error while parsing Struct Type when data is null
user_67630330
•
3
1
662
pyspark azure-databricks apache-spark-sql apache-spark dataframe
Hot Questions