Main Menu Powered by <TEI:TOK> |
TEITOK Help PagesMulti-word ExpressionsTEITOK uses a principle of shallow tokenization: tokens are, different from several other corpus projects, standardly taken as anything between two space (or punctuation marks). Back to index |