Although the paper does not suggest any specific direction for designing better RNN architectures, it provides relevant and significant theoretical results on the expressivity of Unitary RNN. Thus it can be stated that the paper contributes to a better understanding of the capabilities of Unitary RNN and for this reason is worth to be accepted. The rebuttal contributed to clarify issues raised by reviewers.