Full credit goes to Takuan Daikon (of DFGUI), but we happen to share a mailing list, and this is worth spreading.
Throw this script in an Editor folder in your project, and anytime you save and switch back to Unity, it’ll automatically stop playing.
Gist: Stop Playing on Recompile
May 22, 2014