NeurIPS 2020

Sparse and Continuous Attention Mechanisms


Meta Review

The reviewers found the paper well written and novel. I would ask the authors to add discussion of previous work on "parameterized" attention, e.g. https://arxiv.org/abs/1502.04623 or https://arxiv.org/abs/1502.04623. (This is not a suggestion that the authors' work is not novel, but rather that there is some context that would be good to include)