I want to migrate data from AWS EFS to S3?
The total number files required from migrations are huge and will lead to data in TB
What is the best approach to copy files from EFS to S3?
2 Answers
1) Please check the below link. use DataSync to transfer data.
2) Other approach can be
aws s3 sync /sourcepath/ s3://dest
3) AWS data Pipeline
@Gauri, you can either use S3 Sync, run the job in screen to sync files. For those reading who are not familiar with AWS CLI the syntax for S3 Sync is like:
aws s3 sync /pathtosource/ s3://bucketdestination/
Also you can use s3fs to mount bucket in your Server and run rsync job in screen.
Related