apache-spark-sql

2154 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Databricks - FileNotFoundException
user_52126140
•
3
1
4007
pyspark databricks apache-spark-sql dataframe
Pyspark csv write fails with coalesce(1), but runs with repartition(1)
user_60201610
•
3
0
1032
pyspark apache-spark-sql
How to change multiple column values to a constant with out specifying all column names?
user_79342060
•
3
3
842
pyspark apache-spark-sql apache-spark
Number of files in hdfs not equal result of getNumPartitions, how it is possible?
user_108430760
•
3
0
129
pyspark apache-spark-sql apache-spark
How to select top row from spark sql join
user_15112940
•
2
2
536
apache-spark-sql
Find a character index in string in spark sql
user_28417950
•
4
1
18462
pyspark-sql databricks apache-spark-sql
pyspark pass multiple options in dataframe
user_83435980
•
2
3
4440
apache-spark-sql
Convert a spark dataframe to a hive partitioned create table in pyspark using last two columns as partitions
user_27174700
•
2
1
863
pyspark-sql apache-spark-sql python-2.7
Spark convert array of structs to Vector for Euclidean distance
user_50801950
•
3
1
1229
apache-spark-mllib apache-spark-sql apache-spark user-defined-functions
If you save a DataFrame to disk, will Spark load that data if you use that DataFrame lower in the script?
user_139690
•
2
1
154
pyspark apache-spark-sql apache-spark caching python
Hot Questions