Normalization Layers#
Module |
MAdds |
FLOPs |
Parameters |
Memory |
|---|---|---|---|---|
torch.nn.BatchNorm1d |
x |
x |
✓ |
x |
torch.nn.BatchNorm2d |
✓ |
✓ |
✓ |
✓ |
torch.nn.BatchNorm3d |
x |
x |
✓ |
x |
torch.nn.LazyBatchNorm1d |
x |
x |
✓ |
x |
torch.nn.LazyBatchNorm2d |
x |
x |
✓ |
x |
torch.nn.LazyBatchNorm3d |
x |
x |
✓ |
x |
torch.nn.GroupNorm |
x |
x |
✓ |
x |
torch.nn.SyncBatchNorm |
x |
x |
✓ |
x |
torch.nn.InstanceNorm1d |
x |
x |
✓ |
x |
torch.nn.InstanceNorm2d |
x |
x |
✓ |
x |
torch.nn.InstanceNorm3d |
x |
x |
✓ |
x |
torch.nn.LazyInstanceNorm1d |
x |
x |
✓ |
x |
torch.nn.LazyInstanceNorm2d |
x |
x |
✓ |
x |
torch.nn.LazyInstanceNorm3d |
x |
x |
✓ |
x |
torch.nn.LayerNorm |
x |
x |
✓ |
x |
torch.nn.LocalResponseNorm |
x |
x |
✓ |
x |