Lynkco — Lynkco NLP Introduction Course Manual (EN)

Word tokenization in Chinese Chinese words are composed of characters called " hanzi" (or sometimes just " zi ") Each one represents a meaning unit called a morpheme. Each word has on average 2.4 of them. But deciding what counts as a word is complex and not agreed upon.