Swish function

Switch Activation Function

The switch activation function is defined as:

Swish(x)

Arguments

• x: A numeric vector. All elements must be finite and non-missing.

Returns

A numeric vector where the ReLU function has been applied to each element of x.

Details

Examples

Swish(c(-1, 0, 1, 2))

# Can also be used in rxode2:
x <- rxode2({
   r<- Swish(time)
})

e <- et(c(-1, 0, 1, 2))

rxSolve(x, e)

See Also

Other Activation Functions: ELU(), GELU(), PReLU(), ReLU(), SELU(), dELU(), dGELU(), dPReLU(), dReLU(), dSELU(), dSwish(), dlReLU(), dsoftplus(), lReLU(), softplus()

Author(s)

Matthew Fidler