calc_tokenizer_statistics function

Estimate tokenizer statistics