GELU function

GELU activation function

GELU(x)

Arguments

• x: numeric vector

Returns

numeric vector

Examples

GELU(c(-2, -1, 0, 1, 2))

# you can use rxode2 as well
r <- rxode2({
  r = GELU(time)
})
et <- et(c(-2, -1, 0, 1, 2))
rxSolve(r, et)

See Also

Other Activation Functions: ELU(), PReLU(), ReLU(), SELU(), Swish(), dELU(), dGELU(), dPReLU(), dReLU(), dSELU(), dSwish(), dlReLU(), dsoftplus(), lReLU(), softplus()