I used terraform instead of Cloudformation but didn't find it too terrible for what I needed. I realize that it doesn't scale very well to very complicated stuff, but we're talking about using the free tier to prototype things. I'm also not convinced that it's significantly easier to develop locally if you need all that stuff.