I have a scenario where a windows instance has an ebs volume attached to it and an integration microservice feeds a folder with XML extension files. (90GB disk however contains thousands of XML files).
However, this VM is delaying the process and I found that accessing the folders only takes a long time for windows.
I'm designing retention/archive policies to try to work around the problem.
However, the discussion arose about using other types of storage such as S3 or EFS.
In S3 I know that I could make data lifecycle policies to file in other tiers as the XML age or even do via lambda the functions to move files between folders. But mapping s3 on windows won't be simple. (Only with third-party tool). And would I have gained in performance? Would it be too expensive due to the recurring accesses?
In that case I also thought about the EFS. But I question if I would have gained performance in relation to the EBS disk? And is it possible via lambda to create retention policies based on subfolders in EFS?
Thank you so much!