nn_elu function

ELU module

ELU module

Applies the element-wise function:

nn_elu(alpha = 1, inplace = FALSE)

Arguments

  • alpha: the α\alpha value for the ELU formulation. Default: 1.0
  • inplace: can optionally do the operation in-place. Default: FALSE

Details

\mboxELU(x)=max(0,x)+min(0,α(exp(x)1)) \mbox{ELU}(x) = \max(0,x) + \min(0, \alpha * (\exp(x) - 1))

Shape

  • Input: (N,)(N, *) where * means, any number of additional dimensions
  • Output: (N,)(N, *), same shape as the input

Examples

if (torch_is_installed()) { m <- nn_elu() input <- torch_randn(2) output <- m(input) }
  • Maintainer: Daniel Falbel
  • License: MIT + file LICENSE
  • Last published: 2025-02-14