// Hacker Noon · 3 June 2026

On-Device Summaries: Surviving Transcript Pressure

In a refinement flow, a reused LanguageModelSession does not give you free memory. Old prompts and generated summaries stay in the transcript, and that transcript spends the next request’s context budget. Measure before respond(to:), catch exceededContextWindowSize(_:) when the limit is real, and re...

Hacker Noon

@hacker-noon · Tomasz Kubiak

hackernoon.com

Hacker Noon@hacker-noon