I have mapping data flow pipeline in ADF which will take the input file , transform it and then stores the data in CSV format in storage account for each day with day in the name of the file. The input file also has the day in the file name. The Input file for a particular day can be updated. so the output file should be updated accordingly.
The issue what i am facing the where there is an update to the input file, the output is only having the updated information, the old values are getting replaced.
Is there any way where ever the data pipeline runs and it checks on the storage account if the file exists it appends the new records.
