006·334
context window
/ˈkɒntɛkst ˈwɪndoʊ/ - n.
1 [colloq.] A budget the organization fills with everything except the one document that decided the matter.Keep. Punchy.This is the problem.
Working definition
2. The maximum span of tokens a model can attend to in a single request, bounding how much it can consider at once.