Linear Layers#

Module

MAdds

FLOPs

Parameters

Memory

torch.nn.Linear

✓

✓

✓

✓

torch.nn.Bilinear

✓

✓

✓

x

torch.nn.LazyLinear

x

x

x

x

torch.nn.Identity

x

x

x

x