Becoming bitter about how much time husband spends out of the house

I'm a stay at home of a 3 year old and 4 month old baby. I don't have a lot of time to myself and my husband works a lot. He works 6 days a week and is gone from 7 am to 7 pm most days. We make the best of the time he has and he's been helping me with the kids when he gets home from work. He says that he is bored with his day to day and it's always the same. He is telling me that he wants to get in shape and wants to join a kickboxing club that is 3 nights a week. I am already jealous that he gets to go out and work while I stay at home raising the kids, don't get me wrong I love it but would love some time to myself as well. I appreciate that he works hard so I can stay home and we don't have to pay for daycare. I understand that he wants to feel better about himself but I would like that option as well. I think I am depressed as well and having a hard time to keep up with my daily duties as a house wife. Most days I am too busy taking c are of the kids that I don't have a chance to do the dishes. I don't want to tell him that he can't do something for himself. I recommended we join the YMCA so we can have the kids in the daycare there while we both work out. Do more family activities?? He wants to join the kickboxing and there's no daycare. He says he's not interested in the YMCA. My first impression is that he wants to spend more time away from us. I feel that when you spend more time away from your wife and family it put distance between us. He will eventually grow tired of us and move on seeing how much better it is to do everything on his own. Am I over analyzing?

Put the internet to work for you. via Personal Recipe 2629979