nn_hardtanh function

Hardtanh module

Hardtanh module

Applies the HardTanh function element-wise HardTanh is defined as:

nn_hardtanh(min_val = -1, max_val = 1, inplace = FALSE)

Arguments

  • min_val: minimum value of the linear region range. Default: -1
  • max_val: maximum value of the linear region range. Default: 1
  • inplace: can optionally do the operation in-place. Default: FALSE

Details

\mboxHardTanh(x)={1\mboxifx>11\mboxifx<1x\mboxotherwise \mbox{HardTanh}(x) = \left\{ \begin{array}{ll}1 & \mbox{ if } x > 1 \\-1 & \mbox{ if } x < -1 \\x & \mbox{ otherwise } \\\end{array}\right.

The range of the linear region :math:[-1, 1] can be adjusted using min_val and max_val.

Shape

  • Input: (N,)(N, *) where * means, any number of additional dimensions
  • Output: (N,)(N, *), same shape as the input

Examples

if (torch_is_installed()) { m <- nn_hardtanh(-2, 2) input <- torch_randn(2) output <- m(input) }
  • Maintainer: Daniel Falbel
  • License: MIT + file LICENSE
  • Last published: 2025-02-14