Nifi: how to avoid copying file that are partially written

user_6731462 0
Viewed 1739

I am trying to use Nifi to get a file from SFTP server. Potentially the file can be big , so my question is how to avoid getting the file while it is being written. I am planning to use ListSFTP+FetchSFTP but also okay with GetSFTP if it can avoid copying partially written files.

thank you

apache-nifi
3 Answers

There is a minimum file age property you can use. The last modification time gets updated as the file is being written. Setting this value to something other than 0 will help fix the problem:

enter image description here

user_92550050
Related