Home
Packages
Datasets
Task Views
R resources
Packages
Toggle theme
Toggle Menu
Home
Packages
rtiktoken
get_token_count
get_token_count function
Returns the number of tokens in a text
Copy
rtiktoken package
Read PDF manual
Maintainer: David Zimmermann-Kollenda
License: MIT + file LICENSE
Last published: 2025-04-14
Useful links
https://github.com/DavZim/rtiktoken/issues
https://davzim.github.io/rtiktoken/
https://github.com/DavZim/rtiktoken/