[HN Gopher] How Long Contexts Fail
___________________________________________________________________
How Long Contexts Fail
Author : ulrischa
Score : 4 points
Date : 2025-06-30 18:26 UTC (4 hours ago)
(HTM) web link (www.dbreunig.com)
(TXT) w3m dump (www.dbreunig.com)
| rorylaitila wrote:
| There seems to be a need to be some kind of hierarchy to
| contextualization brought to LLMs and not a flat history stuffed
| into the context. For comparison, human memory is not just a
| compressing of linear history of which we rewind the tape when
| needed. Its more like a Russian doll of bounded contexts which we
| break out of, when our inner context is no longer sufficient to
| solve the problem.
___________________________________________________________________
(page generated 2025-06-30 23:01 UTC)