apache-spark

6201 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Spark "first" Window function is taking much longer than "last"
user_5296180
•
7
1
511
pyspark apache-spark-sql apache-spark window-functions performance
Add rows to a PySpark df based on a condition
user_122253000
•
2
1
89
pyspark apache-spark
Spark Count Large Number of Columns
user_8104000
•
2
2
184
apache-spark dataframe scala
Sort data within one output directory created by partitionBy
user_16508420
•
2
1
147
apache-spark partitioning scala sorting
Apache Spark Dataframe How to turn off partial aggregation when using groupBy?
user_74694090
•
3
1
270
hdfs apache-spark hadoop scala java
Apache Spark What happens when repartition($"key") is called when size of all records per key is greater than the size of a single partition?
user_74694090
•
2
2
262
apache-spark-sql-repartition apache-spark-sql apache-spark scala
Find out the closest value PySpark
user_100376890
•
1
1
150
pyspark apache-spark dataframe python
How do I know the Databricks File System (DBFS) file storage format?
user_155036230
•
1
2
1096
databricks apache-spark azure-devops python
PySpark / Spark SQL DataFrame - Error while parsing Struct Type when data is null
user_67630330
•
3
1
662
pyspark azure-databricks apache-spark-sql apache-spark dataframe
Cannot use joinWithCassandraTable in datatricks notebook
user_169799740
•
3
1
65
spark-cassandra-connector databricks apache-spark cassandra
Hot Questions