How to remove UIAlertAction from UIAlertController in Swift?

I know you can disable UIAlertAction buttons in a UIAlertController, but is it possible to remove the button completely once it has been added?