AI Glossary
Context Window
Maximum amount of text a model can process in a single pass.
Definition
The context window is the maximum amount of text – measured in tokens – that a language model can process in a single pass. It includes both input and output. A large context window allows the model to process long documents, entire books, or extensive conversation histories at once. Models with small windows "forget" earlier parts of a conversation. Modern models offer windows from 100,000 to over 1 million tokens.
Related Terms
Sources: a16z AI Glossary · CNET AI Terms Glossary