LeakyReLU module
Applies the element-wise function:
nn_leaky_relu(negative_slope = 0.01, inplace = FALSE)
Arguments
negative_slope
: Controls the angle of the negative slope. Default: 1e-2
inplace
: can optionally do the operation in-place. Default: FALSE
Details
\mboxLeakyReLU(x)=max(0,x)+\mboxnegative_slope∗min(0,x)
or
\mboxLeakyRELU(x)={x,\mboxnegative_slope×x,\mboxifx≥0\mboxotherwise
Shape
- Input: (N,∗) where
*
means, any number of additional dimensions
- Output: (N,∗), same shape as the input
Examples
if (torch_is_installed()) {
m <- nn_leaky_relu(0.1)
input <- torch_randn(2)
output <- m(input)
}