Abstract

RNNs have shown great success in many NLP tasks. It is especially good at processing sequence data. A way to think about RNNs is that they have a “memory” which captures information about what has been calculated so far.

1. What is RNN?
2. What can RNNs do?
3. Implementation of RNN
4. The Problem of Long-Term Dependencies
5. RNN extensions