Browsing: Long

I’ve worked on, conversation state tends to grow quickly over time. It’s common to resend large portions of the history on each turn—including older tool outputs, repeated RAG retrievals, and context that’s no longer relevant. As this accumulates, prompts can become significantly larger, which may increase inference cost and latency, and in some cases affect…