When Does Belief-Based Agent Memory Help? Reliability-Conditional Updating and Provenance-Capped Poisoning Defense
A new preprint introduces Nous, a belief-based memory architecture for LLM agents that uses Bayesian inference and surprise-driven updates. The study finds that belief updating offers little benefit over simpler methods on standard benchmarks, but significantly outperforms them when observations vary in trustworthiness. The authors also propose provenance-capped updating to defend against memory poisoning attacks, and highlight evaluation discrepancies in long-term memory benchmarks.
Why it matters: This work clarifies when probabilistic memory is genuinely useful for LLM agents and introduces practical defenses against memory poisoning, which is important for deploying reliable agents in adversarial settings.
Full story at: arXiv Information Retrieval ↗