apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Merge / concatenate an array of maps into one map in spark SQL with built-ins
user_9972530
•
2
3
1283
pyspark apache-spark-sql apache-spark
more efficient way to get monthly counts in Python/Pyspark
user_62478640
•
3
2
131
pyspark apache-spark-sql apache-spark sql python
Conditions in Spark window function
user_51340560
•
2
3
967
pyspark apache-spark-sql apache-spark window-functions
Adding new column using other existing columns Spark/Scala
user_64856350
•
3
1
103
apache-spark-sql apache-spark dataframe scala
Unable to insert timestamp column from spark df to sql using apache spark connector for sql server
user_53225290
•
2
0
346
apache-spark-sql apache-spark sql-server sql
Dealing with Ties in Rank : Pyspark
user_143171740
•
1
1
353
pyspark apache-spark-sql apache-spark
Does spark caching required on the last common part of 2 actions?
user_152850050
•
2
0
83
pyspark apache-spark-sql apache-spark
Pyspark - df.cache().count() taking forever to run
user_109863970
•
1
1
654
pyspark apache-spark-sql count lazy-evaluation python
Is there a point to cache dataframe if my code has only one action
user_152850050
•
3
0
39
pyspark apache-spark-sql apache-spark
PySpark generating combinations of values for each row
user_158826830
•
2
1
394
pyspark apache-spark-sql apache-spark python
Hot Questions