Model Vocabulary

The vocabulary is the Tokenizer’s fixed list of pieces. Each piece has an ID, and the model can only directly receive IDs from that list.