Artificial intelligence

Token

The smallest piece of text processed by a language model: a part of a word, a punctuation mark, a space. Both the prompt size and the model's processing cost are calculated in tokens.

How much is that in words

For English, one token is about four characters, for Russian it is less: Cyrillic is fragmented more finely. A rough estimate – Russian text costs one and a half to two times more than English text of the same length.

Why you need to know this

If you plan to integrate an assistant into a website, the price is calculated in tokens: both what you send and what the model replies. A long instruction in every prompt – is an expense on every request.

We will check your site against the same points

We will see what holds the site back and tell you where to start. Free, within two business days.