apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
What does the metric "data size" (in Exchange step) represent in the Spark UI's SQL tab?
user_65800800
•
3
0
126
apache-spark-sql apache-spark
Avoid lazy evaluation of code in spark without cache
user_54881730
•
2
2
2688
apache-spark-sql apache-spark
partitionBy & overwrite strategy in an Azure DataLake using PySpark in Databricks
user_93751020
•
8
3
11060
databricks apache-spark-sql apache-spark azure python
Replace elements in an array with its corresponding number in pyspark
user_44524990
•
2
4
2940
pyspark apache-spark-sql apache-spark python-3.x
pyspark dataframe get second lowest value for each row
user_114844630
•
2
2
1270
pyspark-dataframes pyspark apache-spark-sql apache-spark python
Spark Scheduling Within an Application : performance issue
user_100980900
•
5
1
1167
spark-streaming databricks apache-spark-sql apache-spark scala
spark SQL - spark.read.option reading dd-MMM-yyyy from csv into dataFrame
user_27781680
•
2
0
154
apache-spark-sql date
How the number of partitions is decided by Spark when a file is read?
user_38474210
•
2
1
4238
pyspark-dataframes pyspark apache-spark-sql apache-spark
Spark DataFrameWriter ignoreNullFields not working
user_72245970
•
4
2
1842
apache-spark-sql apache-spark
Spark join: grouping of records having same value for a particular column in the same partition
user_22216540
•
2
1
437
apache-spark-sql apache-spark
Hot Questions