Discovery by Dreaming: Cross-Domain Recombination in Artificial Memory
A new preprint proposes that the primary function of memory consolidation—both biological and artificial—is to enable cross-domain recombination of knowledge, similar to the process of dreaming. The authors implement this mechanism in two distinct systems: a LoRA fine-tuning pipeline (DREAMS) and a symbolic engine (SAPIENCE). They find that cross-domain consolidation yields substantial gains in generating novel connections and improving performance on cross-domain tasks, while within-domain rehearsal does not. The symbolic system achieves 85.7% novel cross-domain connections, and the neural system shows up to +14.5 percentage point improvement on cross-domain tasks.
Why it matters: This work introduces a potentially general principle for AI and neuroscience, suggesting that offline recombination of knowledge—analogous to dreaming—may be essential for discovery and generalization across domains.
Full story at: arXiv Information Retrieval ↗