I would say that if you two are not happy then go to a marrage councilor. If he is not interested and think he doesn't have a problem then...maybe.. you do have to leave him. Two people have to work together to make things work and it is just like a bycicle.. if one wheel is loose you are likely to crash unless it gets straightened.. so you need ot tlka to him... tell him what you want out of life and him in a nice calm way... LET HIM KNOW WHAT YOU WANT AND most importantly NEED!
You will be happier when you do so ... And if he doesn't cooperate and/or doesn't want to work things out then why be with someone who doesn't try as hard as you and/ or work as hard to make the other half happy
