Can someone please let me know the use/How it works the command data.write.format(“noop”).mode(“overwrite”).save() in Pyspark 3.0?
1 Answers
The "noop" command is useful when you need to simulate a write without any data, for example, imagine that you want to check the performance of your job, however you just want to check the effects of saving to your storage without doing it properly.
Related