Derivatives of GELU
dGELU(x) d2GELU(x) d3GELU(x) d4GELU(x)
x
: numeric vectornumeric vector
dGELU(c(-2, -1, 0, 1, 2)) d2GELU(c(-2, -1, 0, 1, 2)) d3GELU(c(-2, -1, 0, 1, 2)) d4GELU(c(-2, -1, 0, 1, 2)) # you can use rxode2 as well r <- rxode2({ r1 <- dGELU(time) r2 <- d2GELU(time) r3 <- d3GELU(time) r4 <- d4GELU(time) }) et <- et(c(-2, -1, 0, 1, 2)) rxSolve(r, et)
Other Activation Functions: ELU()
, GELU()
, PReLU()
, ReLU()
, SELU()
, Swish()
, dELU()
, dPReLU()
, dReLU()
, dSELU()
, dSwish()
, dlReLU()
, dsoftplus()
, lReLU()
, softplus()
Useful links