It seems that when you use the firebase emulator but have no internet connection you can't load the firebase scripts like http://localhost:5000/__/firebase/8.4.2/firebase-app.js the local server that is created by firebase emulator must be actually fetching the firebase-app.js from google firebase servers and serving that back through localhost.
Is it possible to use Firebase Emulator without an internet connection?