Softplus Activation Function
softplus(x)
x
: numeric vectornumeric vector
softplus(c(-1, 0, 1, 2)) # You can use rxode2 too: r <- rxode2({ s <- softplus(time) }) e <- et(c(-1, 0, 1, 2)) rxSolve(r, e)
Other Activation Functions: ELU()
, GELU()
, PReLU()
, ReLU()
, SELU()
, Swish()
, dELU()
, dGELU()
, dPReLU()
, dReLU()
, dSELU()
, dSwish()
, dlReLU()
, dsoftplus()
, lReLU()
Matthew L. Fidler
Useful links