It is important to understand the algorithms we aim to apply to many problems of interest. In that light, and given the popularity of these algorithms, a finite-time analysis of actor-critic methods is a nice contribution to the field, and we happily accept this paper for publication at NeurIPS.