Set default working directory when opening new terminal with VS Code

I'm using Visual Studio Code with the integrated terminal.

When opening a new terminal in a workspace with multiple folders I always receive a prompt saying:

Select current working directory for new terminal

How do I remove this prompt i.e. Set the default to always use the directory of the first folder?