nnf_normalize function

Normalize

Performs $L_p$ normalization of inputs over specified dimension.

nnf_normalize(input, p = 2, dim = 2, eps = 1e-12, out = NULL)

Arguments

• input: input tensor of any shape
• p: (float) the exponent value in the norm formulation. Default: 2
• dim: (int) the dimension to reduce. Default: 1
• eps: (float) small value to avoid division by zero. Default: 1e-12
• out: (Tensor, optional) the output tensor. If out is used, this operation won't be differentiable.

Details

For a tensor input of sizes $(n_0, ..., n_{dim}, ..., n_k)$, each $n_{dim}$ -element vector $v$ along dimension dim is transformed as

With the default arguments it uses the Euclidean norm over vectors along dimension $1$ for normalization.