March 1, 2024
Difference between nn.ReLU() and nn.ReLU(inplace=True).
PyTorchPragatiIn-place operations are recognizable from a trailing underscore in their name, like relu_, which indicates that the method operates in place by modifying the input instead of creating a new output tensor and returning it.