AI Reference 052 Large Language Models Wikipedia guided Primary sources linked

Context Windows

Definition

A context window is the amount of tokenized information a model can consider in one working sequence or request. Larger context increases capacity for long inputs but does not guarantee perfect retrieval or reasoning over every detail.

What is a context window?

A context window is the maximum token sequence a model can consider during one working interaction or inference operation. It includes instructions, user input, retrieved material, prior messages and often the model's own generated tokens.

Why a larger context helps

More context allows longer documents, more conversation history or larger codebases to be supplied at once. That can reduce the need to split material manually and can make some retrieval tasks easier.

Why context is not memory

A long context window is temporary working input, not permanent personal memory. Models may also fail to use every part of a long context equally well. Production systems often combine context with retrieval, summarization and separate memory stores instead of simply inserting everything into one enormous prompt.

Related terms, defined

Large Language Models Embeddings in Modern AI Embeddings are dense numerical vectors used to represent text, images or other objects in spaces where distance or similarity can be computed. Large Language Models Inference Inference is the phase in which a trained model is run to make predictions or generate outputs. LLM inference usually produces tokens sequentially. Large Language Models Temperature and Sampling Temperature changes the probability distribution used during sampling. Lower values concentrate probability more strongly; higher values make less likely alternatives easier to sample. Large Language Models AI Hallucinations A hallucination is generated content that is false, unsupported or inconsistent with the evidence available to the system. Language generation optimizes likely sequences, not guaranteed factual truth, so high-stakes factual work needs grounding and verification. Large Language Models Retrieval-Augmented Generation Retrieval-augmented generation combines a generative model with retrieval from an external collection such as documents, databases or search results. Retrieved material is inserted into the model's context so the answer can be grounded in information outside the model's parameters.

Reference guide and primary sources

Wikipedia is used here as a terminology and history reference guide. Current model versions, institutional statistics and product-specific claims are also linked to first-party or institutional sources because those details can change faster than encyclopedia articles.

← Tokenization Embeddings in Modern AI →