Hardswish module
Applies the hardswish function, element-wise, as described in the paper: Searching for MobileNetV3
nn_hardswish()
Details
\mboxHardswish(x)=⎩⎨⎧0xx⋅(x+3)/6\mboxifx≤−3,\mboxifx≥+3,\mboxotherwise
Shape
- Input: (N,∗) where
*
means, any number of additional dimensions
- Output: (N,∗), same shape as the input
Examples
if (torch_is_installed()) {
## Not run:
m <- nn_hardswish()
input <- torch_randn(2)
output <- m(input)
## End(Not run)
}