nnf_contrib_sparsemax function

Sparsemax

Applies the SparseMax activation.

nnf_contrib_sparsemax(input, dim = -1)

Arguments

• input: the input tensor
• dim: The dimension over which to apply the sparsemax function. (-1)

Details

The SparseMax activation is described in 'From Softmax to Sparsemax: A Sparse Model of Attention and Multi-Label Classification'

The implementation is based on aced125/sparsemax