Default Softplus Activation Function
dsoftplus(x) d2softplus(x) d3softplus(x) d4softplus(x)
x
: numeric vectornumeric vector
dsoftplus(c(-1, 0, 1, 2)) # You can use rxode2 too: r <- rxode2({ s1 <- dsoftplus(time) }) e <- et(c(-1, 0, 1, 2)) rxSolve(r, e)
Other Activation Functions: ELU()
, GELU()
, PReLU()
, ReLU()
, SELU()
, Swish()
, dELU()
, dGELU()
, dPReLU()
, dReLU()
, dSELU()
, dSwish()
, dlReLU()
, lReLU()
, softplus()
Matthew L. Fidler
Useful links