model_wordpiece function

An implementation of the WordPiece algorithm

tok packageRead PDF manual
  • Maintainer: Daniel Falbel
  • License: MIT + file LICENSE
  • Last published: 2025-09-30

Useful links