How do make SwaggerGen in .net core make operation paths relative?

I am running a couple of .net core webapi behind a reverse proxy. I have gotten the Swagger UI to load the swagger json. However, the operations' paths in json document are not relative,which breaks the try it out feature of the SwaggerUI as request are sent to root. How would I go about making the request relative ?