https://papers.nips.cc//paper/6606-wider-and-deeper-cheaper-and-faster-tensorized-lstms-for-sequence-learning Wider and Deeper, Cheaper and Faster: Tensorized LSTMs for Sequence Learning Long Short-Term Memory (LSTM) is a popular approach to boosting the ability of Recurrent Neural Networks to store longer term temporal information. The capacity of an LSTM network can be increased by widening and