Can I build a PyInstaller binary for M1 Macs on an Intel Mac?

I have recently found out that PyInstaller now works on macOS Monterey, so I tried to build a binary. When testing on my Intel machine, it did work as expected. When testing it on an M1 MacBook, however, it failed to work because of "Damaged and cannot open". I think that was because of the incompatibility of Intel apps and M1 apps.
CLang has an option to build for a different architecture, but I don't know if PyInstaller has such parameter that does the same job.

Proof: From the picture, the app is clearly stated to be an "Intel" app. Thanks for any ideas.