Atmospheric models often include random forcings, which aim to replicate the impact of processes too small to be resolved. Recent results in simple atmospheric models suggest that this random forcing can actually stabilise certain slow-varying aspects of the system, which could provide a path for resolving known errors in our models. We use randomly forced simulations of a toy chaotic system and theoretical arguments to explain why this strange effect occurs – at least in simple models.