plural tokens
1
a
: a piece resembling a coin issued for use (as for fare on a bus) by a particular group on specified terms
b
: a piece resembling a coin issued as money by some person or body other than a de jure government
c
: a unit of a cryptocurrency
Bitcoin tokens
2
: an outward sign or expression
His tears were tokens of his grief.
3
4
b
: a small part representing the whole : indication
This is only a token of what we hope to accomplish.
c
: something given or shown as a guarantee (as of authority, right, or identity)
5
: a member of a group (such as a minority) that is included within a larger group through tokenism
especially
: a token employee
6
: a distinguishing feature : characteristic
7
computing
: the fundamental unit of data that is processed by AI and that is sometimes used as a measure of AI computing or performance
Tokens are the basic units of input and output in a language model.—
Andrius Grybauskas et al.
For large language models (LLMs), short words may be represented with a single token, while longer words may be split into two or more tokens.—
Dave Salvator
… the token, the basic unit used to measure AI computing. Every prompt consumes tokens.—
Matias Civita
Simple applications like text generation use fewer tokens, while coding, video, and image creation use more.—
Shelby Gutleber
see also:
1
a
: representing no more than a symbolic effort : minimal, perfunctory
token resistance
token integration
b
: serving or intended to show absence of discrimination
a token female employee
2
: done or given as a token especially in partial fulfillment of an obligation or engagement
a token payment
Love words? Need even more definitions?
Merriam-Webster unabridged



