The Vanishing Policy
Explain why a model may miss facts that are outside or buried inside the usable context window.
busy people operations desk with a real specialist reviewing a laptop, a long stack of printed chat history fading into the background, a current policy document placed near the keyboard, bright corporate office with clean white walls and green plants, no text, words, letters, numerals, logos. A people ops specialist has a long conversation history spread across the desk, while the current policy document sits apart near the laptop. The model's answer appears to have used old context. The updated leave policy was mentioned far earlier in the chat. Jon needs an accurate leave-policy summary. The chat is very long,…
Sign up free — one personalized lesson every day, matched to your role and goals.
Already have an account? Sign in