chunked/content_aware_chunking/_glossary/chunk_140.txt

token
A part of a sentence, usually a word, but can also be a subword (non-common words are often split in subwords) or a
punctuation symbol.