Layer

Any operations in a deep network is a layer. It takes one or more Tensors as input and produces one or more output tensors. Depending on the deep learning framework layers have associated parameters with can be updated, saved and restored.

See torch.nn, torch.nn.Parameter, torch.nn.Module for more details.