Recurrent Neural Networks

Process sequence

• ono to one, vanilla neural networks
• one to many, image captioning
• many to one, seq of words to sentiment
• many to many, seq of words to seq of words
• old state as one of the input to get new state
• reuse the same weight matrix at every time step