Google taught an LLM to sleep. The Sleep framework flips a model between awake and asleep. Awake, it works and dumps everything it learns into short-term memory, which is volatile by design. Then it goes offline: input off, MoE expansion writes that memory into the weights, and random experts "dream" over it to refine things.
Google taught an LLM to sleep. Google taught an LLM to sleep.