How to Beat Your Control