nn_leaky_relu function

LeakyReLU module

LeakyReLU module

Applies the element-wise function:

nn_leaky_relu(negative_slope = 0.01, inplace = FALSE)

Arguments

  • negative_slope: Controls the angle of the negative slope. Default: 1e-2
  • inplace: can optionally do the operation in-place. Default: FALSE

Details

\mboxLeakyReLU(x)=max(0,x)+\mboxnegative_slopemin(0,x) \mbox{LeakyReLU}(x) = \max(0, x) + \mbox{negative\_slope} * \min(0, x)

or

\mboxLeakyRELU(x)={x,\mboxifx0\mboxnegative_slope×x,\mboxotherwise \mbox{LeakyRELU}(x) =\left\{ \begin{array}{ll}x, & \mbox{ if } x \geq 0 \\\mbox{negative\_slope} \times x, & \mbox{ otherwise }\end{array}\right.

Shape

  • Input: (N,)(N, *) where * means, any number of additional dimensions
  • Output: (N,)(N, *), same shape as the input

Examples

if (torch_is_installed()) { m <- nn_leaky_relu(0.1) input <- torch_randn(2) output <- m(input) }
  • Maintainer: Daniel Falbel
  • License: MIT + file LICENSE
  • Last published: 2025-02-14