Is that possible for Win32/64 application to receive push notification message from Firebase?

No, firbase is only available for android/ios and javascript. javascript mean that in some way we can play in win32/64 system, but you will need to analyze the javascript protocole to emulate it inside your win32/64 software. Maybe a more easy way will be to use somethink like node.JS inside your software to emulate a browser and javascript