DMelt:AI/4 Recurrent NN and LSTM

From jWork.ORG
Revision as of 19:21, 6 December 2017 by Jworkorg (talk | contribs)
Jump to: navigation, search
Limitted access. Reguest membership or login to this link first if you are already a member
Contents

Recurrent Neural Networks (RNN) and LSTM

Recurrent Neural Networks (RNN) and Long Short-Term Memory Networks (LSTM) are included using recunn/ library.


The demo is pre-filled with sentences from Paul Graham's essays, in an attempt to encode Paul Graham's knowledge into the weights of the Recurrent Networks. The long-term goal of the project then is to generate startup wisdom at will. Feel free to train on whatever data you wish, and to experiment with the parameters. If you want more impressive models you have to increase the sizes of hidden layers, and maybe slightly the letter vectors. However, this will take longer to train.

More information on this topic is in DMelt books