Moment Prisons, and How to Escape Them