apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
How to calculate the counts of each distinct value of all the columns in a pyspark dataframe?
user_171089070
•
1
1
265
pyspark apache-spark-sql apache-spark dataframe
Group by date range overlapping using PySpark
user_16506300
•
1
1
331
pyspark apache-spark-sql apache-spark dataframe sql
YTD and MTD of Mutual Fund using PySpark
user_67557810
•
1
1
259
pyspark apache-spark-sql apache-spark dataframe python
How to randomly shuffle the values of only one column in pyspark?
user_80896950
•
1
2
283
pyspark apache-spark-sql apache-spark
Pyspark's write stringtype argument doesn't deal with null values
user_42156270
•
3
1
360
pyspark apache-spark-sql apache-spark uuid postgresql
Select a column based on another column's value in Spark Dataframe using Scala
user_174325800
•
2
1
846
apache-spark-sql apache-spark dataframe scala
create median and average column out of array column in pyspark
user_58682930
•
1
1
287
pyspark apache-spark-sql apache-spark dataframe python-3.x
Spark Structured Streaming: StructField(..., ..., False) always returns `nullable=true` instead of `nullable=false`
user_117128160
•
2
2
251
spark-structured-streaming apache-kafka apache-spark-sql apache-spark scala
How to handle Circular reference in Spark using Java
user_104691940
•
1
0
53
apache-spark-sql apache-spark
Spark Streaming - Checkpoint State EOF Exception
user_65129710
•
1
0
77
spark-structured-streaming apache-spark-sql apache-spark scala
Hot Questions