Adding a Daydreaming Loop Could Give LLMs True Insight
Gwern proposes adding a default‑mode ‘daydreaming’ loop to LLMs: a background process that samples concept pairs, generates novel links, and filters for value. This continuous, costly search could unlock genuine breakthroughs and supply proprietary data for future, more efficient models.