apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Opening a json column as a string in pyspark schema and working with it
user_64156300
•
2
1
83
pyspark apache-spark-sql apache-spark dataframe json
Pyspark label rows based on time window and double condition match
user_180824010
•
1
3
289
pyspark apache-spark-sql apache-spark sql python
Spark join two dataframes on best .startswith match
user_114771370
•
1
2
447
apache-spark-sql apache-spark dataframe scala
Understanding groupby after repartition in pyspark
user_80896950
•
1
0
101
pyspark apache-spark-sql apache-spark group-by
Replace Nulls of Struct type column using Pyspark
user_61797850
•
1
2
681
pyspark databricks apache-spark-sql apache-spark python
What is the best way to build event counts for certain time resolution over multiple names in Spark dataframe while groupby?
user_104527000
•
1
1
150
pyspark azure-databricks databricks apache-spark-sql apache-spark
DecimalType(20, 0) does not hold 7 digit integer in spark
user_95994660
•
2
1
126
pyspark apache-spark-sql apache-spark dataframe
Speeding up a custom aggregate for window function
user_27893340
•
1
1
56
pyspark apache-spark-sql apache-spark dataframe user-defined-functions
How to get all rows with null value in any column in pyspark
user_149822190
•
3
1
1052
pyspark apache-spark-sql apache-spark dataframe
DESCRIBE TABLE see which columns are NOT NULL
user_139630860
•
1
2
607
azure-databricks databricks apache-spark-sql apache-spark
Hot Questions