sentencepiece_encode function

Tokenise text alongside a Sentencepiece model

sentencepiece package Read PDF manual

Maintainer: Jan Wijffels
License: MPL-2.0
Last published: 2022-11-13
https://github.com/bnosac/sentencepiece