Recurrent Layers#

Module

MAdds

FLOPs

Parameters

Memory

torch.nn.RNNBase

x

x

✓

x

torch.nn.RNN

x

x

✓

x

torch.nn.LSTM

x

x

✓

x

torch.nn.GRU

x

x

✓

x

torch.nn.RNNCell

x

x

✓

x

torch.nn.LSTMCell

x

x

✓

x

torch.nn.GRUCell

x

x

✓

x