I predict as soon as it is possible to give the LLMs states, we will do so everywhere.
The fact that current agents are blank slates at the start of each session is one of the biggest reasons they fall short at lots of real-world tasks today - they forget human feedback as soon as it falls out of the context window, they don't really learn from experience, they need whole directories of markdown files describing a repository to not forget the shape of the API they wrote yesterday and hallucinate a different API instead. As soon as we can give these systems real memory, they'll get it.
The fact that current agents are blank slates at the start of each session is one of the biggest reasons they fall short at lots of real-world tasks today - they forget human feedback as soon as it falls out of the context window, they don't really learn from experience, they need whole directories of markdown files describing a repository to not forget the shape of the API they wrote yesterday and hallucinate a different API instead. As soon as we can give these systems real memory, they'll get it.