Tensor

A tensor is a d-dimensional array and serves as the input and output of every layer of a deep network. Tensors have many mathematical operations associated with them (extensions of matrix multiplication). However, those operations are not used in most deep learning frameworks, and a Tensor is simply an array of numbers.

See pytorch and wikipedia for more info. Note that wikipedia focues mostly on the mathematical definition, less used in deep learning.