mistral-common is a toolkit to help you handle Mistral models. It not only includes text-to-token conversion but also adds tool parsing and structured dialogue. Three versions of the tokenizer have been released, each suitable for different model collections.