Environment "Competitive RL"'s original repo is https://github.com/cuhkrlcourse/competitive-rl.
You can refer to it for guide on installation and usage.