Cognito User Pool doesn't Retain users

Changing Cognito User Pool schema that's provisioned with DeletionPolicy: Retain using serverless deletes the whole user pool. But adding a custom attribute using the console isn't destructive.