Here's my story, then. For most of my life, I've never had a friend who's been interested in anything but sports, alcohol or a combination of the two. I've been suicidal at times, had a few periods with drug problems, I've had two girlfriends and was dumped by both of them (No, not simultaneously). And I have similar problems with saying no as OP describes.
I just recently got a job, though. Not one of those two or three month deals either, but real employment until further notice. And it's a decently fun job, with awesome coworkers. I see a therapist regularly, and it does help. A friend will show me around his smithy once he finishes moving it.
On the whole, life's good. So here's a pape that usually makes me smile.