This paper presents an RL-approach for optimizing web crawling strategy by modeling freshness of the remote content. Reviewers were unanimously in favor of accepting the paper, appreciating the formulation of the problem and the extent of the scale of experiments.