BPEembed function

Tokenise and embed text alongside a Sentencepiece and Word2vec model

sentencepiece package Read PDF manual

Maintainer: Jan Wijffels
License: MPL-2.0
Last published: 2026-02-09 14:40:02 UTC
https://github.com/bnosac/sentencepiece