AWS DMS Tasks Will Not Delete

user_5376315 0
Viewed 829

I am trying to delete two AWS DMS database "migration" tasks that are in the failed state. After over 30 tries from the console, where it shows a green banner and displays that the tasks are deleted - the tasks are still there. I also attempted to delete the dms tasks using the aws cli and get the same result. The event log for DMS shows the following:

dms-copy-task   replication-task    May 3, 2021, 22:48:37 (UTC-04:00)   Failed to clean task resources for task dms-copy-task during task deletion
dms-copy-task   replication-task    May 3, 2021, 22:47:06 (UTC-04:00)   Replication task has been deleted.

May someone please tell me how I can get rid of these tasks at this point? My objective is to clean up the entire DMS replication instance, but I cannot without deleting the tasks first.

aws-dms
2 Answers

DMS task could not be deleted due to the source PostgreSQL database is unreachable. It occurs when a DMS task with a PostgreSQL compatible source attempts to and is unable to delete the Replication Slots on the source, to overcome this, please consider changing the following Modification to the DMS Task Settings:

Change:
    > "FailTaskWhenCleanTaskResourceFailed": true
to
    > "FailTaskWhenCleanTaskResourceFailed": false

Please kindly note that parameter "FailTaskWhenCleanTaskResourceFailed" is set to true by default to avoid having replication slot active on the source database (Aurora Postgres) which would lead to growth in WAL files. So it is recommend to check the source replication slots manually and verify it is removed so that there wont be growth of space in the source RDS instance due to un-utilised replication slots.

Once it is taken care please updated the "FailTaskWhenCleanTaskResourceFailed" to false following the below steps, This would cause DMS to evaluate the delete process differently allowing the DeleteReplicationTask API Call to complete without encountering the error "Drop the slot manually".

Modifying the Task JSON:

1. Select the DMS Task
2. Choose Modify
3. Scroll to the "Task settings" section
4. Choose the "JSON editor"
5. Scroll towards the bottom and set the following:
    "FailTaskWhenCleanTaskResourceFailed": false
6. Save the Task settings
7. Delete the DMS task.

Soure & Credit:

AWS Tech Support Team

user_118653980

See comments above. I was able to clean up DMS by moving the DMS tasks back to a working state through re-configuration, then stopping them and then deleting them.

user_53763150
Related