Skip to content
Vol. I · No. 251
Mon · 8 Jun
A Daily Lexicon of Trustworthy Data
The Lexicon

006·354

token

/ˈtoʊkən/ - n.

1 [colloq.] The smallest thing in the program with a clearly assigned cost and owner.Keep. Punchy.This is the problem.

Working definition

2. The sub-word unit a model reads and generates, and the unit by which usage is billed.

Filed
See also
  • context windowA budget the organization fills with everything except the one document that decided the matter.
  • foundation modelA general-purpose engine bought to solve a problem the org had not yet agreed to define.
  • inferenceThe part priced per call, unlike the definitions it relies on, which are free and missing.
  • prompt engineeringWriting the requirements doc you skipped, one sentence at a time, into a text box.