An openai/atari-py fork with Windows support and removed zlib/libpng dependencies.
To simply install atari-py wheels (binaries) use this command:
pip install -f https://github.com/Kojoley/atari-py/releases atari_py
If you have any distutils supported compiler you can install from sources:
pip install git+https://github.com/Kojoley/atari-py.git