I've been using Webfaction for a few years. Never had one issue with them.
$9.50 per month I guess there are cheaper ones out there.