Lexical token (Q2143407)
Jump to navigation
Jump to search
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence
- lexical token
- token
| Language | Label | Description | Also known as |
|---|---|---|---|
| English | Lexical token |
in lexical analysis, atomic string with an assigned and thus identified meaning; can be either word, bi-gram or sentence |
|
Statements
Identifiers
Sitelinks
Wikipedia(6 entries)
- arwiki توكن
- dewiki Token (Übersetzerbau)
- enwiki Lexical token
- jawiki 字句
- skwiki Token (text)
- ukwiki Токен