There was a consensus by the reviewers that this paper should be accepted. The paper provides a Cuda implementation of the ATARI simulator which allows for the running of RL experiments on GPUs. This is a solid contribution and has the clear potential to literally accelerate reinforcement learning research.