Parametric ReLU Activation Function
PReLU(x, alpha = 1)
x
: A numeric vector. All elements must be finite and non-missing.alpha
: A numeric scalar. All elements must be finite and non-missing.A numeric vector where the ReLU function has been applied to each element of x
.
PReLU(c(-1, 0, 1, 2), 2) # Can also be used in rxode2: x <- rxode2({ r=PReLU(time, 2) }) e <- et(c(-1, 0, 1, 2)) rxSolve(x, e)
Other Activation Functions: ELU()
, GELU()
, ReLU()
, SELU()
, Swish()
, dELU()
, dGELU()
, dPReLU()
, dReLU()
, dSELU()
, dSwish()
, dlReLU()
, dsoftplus()
, lReLU()
, softplus()
Matthew Fidler
Useful links