Context window

The context window includes everything the model “sees”: system instructions, the conversation so far, attached documents and its own answer. Whatever does not fit is unknown to the model in that request.

Some modern models offer very large windows that can hold entire books. Still, the more content, the more expensive and slower the request, and important details can be overlooked in long contexts.