RNN RNN Notes Recurrent Neural Network Input Hidden State Output We can process a sequence of vectors x by applying a recurrence of formula at every time step. ht = fw(ht-1, xt)