32MB is not enough to do anything these days, but you should be able to get a VPS with much more than that for not a lot these days. I've been using http://OpenHosting.com/ VPSs and am very happy. Their VServer line doesn't have a specific amount of memory allocated - you can use up to (I think) 4GB as you need it (they call it utility pricing), and at least in my experience I never got charged more than the base monthly fee. Plus the support's been great as well as the uptime and performance.

Dan