nn_hardswish function

Hardswish module

Hardswish module

Applies the hardswish function, element-wise, as described in the paper: Searching for MobileNetV3

nn_hardswish()

Details

\mboxHardswish(x)={0\mboxifx3,x\mboxifx+3,x(x+3)/6\mboxotherwise \mbox{Hardswish}(x) = \left\{\begin{array}{ll}0 & \mbox{if } x \le -3, \\x & \mbox{if } x \ge +3, \\x \cdot (x + 3)/6 & \mbox{otherwise}\end{array}\right.

Shape

  • Input: (N,)(N, *) where * means, any number of additional dimensions
  • Output: (N,)(N, *), same shape as the input

Examples

if (torch_is_installed()) { ## Not run: m <- nn_hardswish() input <- torch_randn(2) output <- m(input) ## End(Not run) }
  • Maintainer: Daniel Falbel
  • License: MIT + file LICENSE
  • Last published: 2025-02-14