Derivative of Leaky ReLU activation function
dlReLU(x)
x
: numeric vectornumeric vector
dlReLU(c(-1, 0, 1)) # Can use in rxode2 as well r <- rxode2({r <- dlReLU(time)}) e <- et(c(-1, 0, 1)) rxSolve(r, e)
Other Activation Functions: ELU()
, GELU()
, PReLU()
, ReLU()
, SELU()
, Swish()
, dELU()
, dGELU()
, dPReLU()
, dReLU()
, dSELU()
, dSwish()
, dsoftplus()
, lReLU()
, softplus()
Useful links