Installing gcc from source with no internet

I want to install GCC from a USB stick from the source because I have no Internet(Ethernet and Tethering aren't possible either). I have a Ubuntu Windows dual boot and want to download GCC while on windows on a USB and then install GCC from this onto ubuntu. But for the ./configure to work I need a C compiler, which I'm trying to install(GCC). Any Ideas on how to install it without needing a C compiler?