I try to write a pyspark dataframe to a parquet like this
df.write.parquet("temp.parquet", mode="overwrite")
but it creates an empty folder named temp.parquet instead of a parquet file. What might cause this problem?
I try to write a pyspark dataframe to a parquet like this
df.write.parquet("temp.parquet", mode="overwrite")
but it creates an empty folder named temp.parquet instead of a parquet file. What might cause this problem?