Character-based Tokenization Approach Splitting the text into individual characters Advantages There will be no or very few unknown words (Out Of Vocabulary) Useful for languages that characters carry information Fewer number of tokens Easy to implement Disadvantages A character usually does not have a meaning Cannot learn semantic for words Larger sequence to be processed by models More input to process