I am trying to use keras-rl but in a multi-agent environment. So I found this github issue of keras-rl with an idea using shared environment for all agents. Unfortunately, I haven't managed to get it working. It seems that using a gym environment in such context is possible in general, I just haven't managed to get it working with keras-rl. Anybody that know how to do it?