I'm trying to save a data frame to object storage:
print(type(saveDF))
<class 'pyspark.sql.dataframe.DataFrame'>
Then:
saveDF.write().option("header", "true").csv("pre-processed")
Results in:
TypeErrorTraceback (most recent call last)
<ipython-input-90-d20d6b31a2d4> in <module>()
1 ----> saveDF.write().csv("pre-processed")
TypeError: 'DataFrameWriter' object is not callable
I've seen a number of other questions with this problem, but the questions are using a different approach to saving as a csv.