Have a read of this article:
Warning Signs That You're Dating a Loser
If things line up, dump him. It's just that simple. You will find new friends and you will get some (if you're a woman, heck, go the club and just say yes. Get on Plenty of Fish and just say yes. For men, not so easy, but there are other ways...).
Do yourself a favour and take the advice of someone on this board.
All the best.