apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
PySpark explode stringified array of dictionaries into rows
user_44474750
•
5
1
4546
pyspark apache-spark-sql apache-spark dataframe python
Improved Performance when using Window.partitionBy instead of groupBy
user_68059790
•
3
0
612
apache-spark-sql apache-spark window-functions
What is an efficient way to apply a relative count based eligibility criteria to Spark dataframe in Scala?
user_23717230
•
3
0
357
apache-spark-sql apache-spark scala
Spark Partitioning Hive Table
user_111572230
•
3
2
6271
hiveql apache-spark-sql apache-spark hive scala
Spark sampling options in JSON reader ignored?
user_753860
•
5
1
3253
pyspark apache-spark-sql apache-spark
Use Map to replace column values in Spark
user_54775310
•
12
2
14949
apache-spark-sql apache-spark scala
Perform lookup on a broadcasted Map conditoned on column value in Spark using Scala
user_116320690
•
3
1
476
apache-spark-sql apache-spark scala
Window Function Tie breaker on other field to get the Latest Record
user_70822210
•
5
2
1132
pyspark-sql pyspark apache-spark-sql apache-spark sql
JDBC to Spark Dataframe - How to ensure even partitioning?
user_19337680
•
7
2
7402
apache-spark-sql apache-spark partitioning jdbc
How to handle small file problem in spark structured streaming?
user_32520970
•
14
3
5540
spark-streaming parquet apache-spark-sql apache-spark
Hot Questions