SwiftUI Accessibility VoiceOver Focus Issue

I have one button on a screen and on tap of that button i am opening one modal (view). But after closing that view accessibility VoiceOver focus goes to top left element on the screen. I want that focus to stay on the same button after closing that view.