DMelt:AI/4 Recurrent NN and LSTM

From jWork.ORG
Revision as of 19:26, 6 December 2017 by Jworkorg (talk | contribs)
Jump to: navigation, search
Limitted access. Reguest membership or login to this link first if you are already a member
Contents

Recurrent Neural Networks (RNN) and LSTM

Recurrent Neural Networks (RNN) and Long Short-Term Memory Networks (LSTM) are included using recunn/ library. Recurrent networks and their popular type, LSTM, are artificial neural network designed to recognize patterns in sequences of data, such as text, sequences, handwriting, the spoken words, or numerical times series.

Here is a demo that reads sentences from Paul Graham's essays, encoding Paul Graham's knowledge into the weights of the Recurrent Networks.

The above example is based on JavaScript library http://cs.stanford.edu/people/karpathy/recurrentjs/

More information on this topic is in DMelt books