How to enjoy all of boxing when you dislike structure and having to do things?

How to enjoy all of boxing when you dislike structure, stress, and having to do things? That's really what I'm seeking, because I'm about to go back to the gym soon but there's a lot about boxing that I dislike that has nothing to do with the actual sport. It's not the heavybag work, sparring, or increasing my boxing skills, I like those, but the other things.
Like having to go to the gym at a certain time, it's right around supper time and it's dark outside now and I hate that, I'd rather train when I want to or have the training session in the daytime. Like I do when I'm at a fitness center.
Driving out to the gym, I had a car wreck late last year returning from boxing, so if i have one more carwreck I'm screwed, and I can't see well at night when I'll clearly be driivng to and from the gym. So I'm taking a gamble of life by going to the gym to an extent.
Having to do what everyone says at the gym concerning wearing baggy clothes to increase loss of weight/water, the peer pressure involved with it that you need to go to the gym a certain amount of times even when you don't feel like it and the notion that quitting anything is unmanly and leaving the gym before having any fights means you didn't have what it takes and more macho bs I dislike, and my trainer going to pressure me to compete even when I'd prefer to take my time and just train for 3 months to increase my boxing skills for when I go to another gym, but my trainer now has the notion of "If you don't compete, we shouldn't waste your time on you here".
It's not that I don't want to compete, it's that I'm a weekend worker when all the amateur fights are, and I'd like to take my time with amateur boxing and be smart about it, it's not worth getting my head beat in just to feel a belonging at a gym.
I also feel very stressed and obsessed with boxing when I do it, it makes me lose focus on everyday subjects and I screwed up doing work a few times because of the focus on it, and it's usually not a positive obsession or stress.
My parents hate me doing it and try to discourage me from doing it.
Also I'll be paying money in membership, not so bad, but gas money also, so if I'm paying a good amount of money every month I damn well better enjoy just about everything.
So now I want to go back to boxing but I feel all this negativity holding me back, it's not that I don't have what it takes, I do, but I'd just like to go to the gym when I feel like it and just enjoy myself and enjoy life instead of all this negativity around me. I felt depressed and trapped late last year at the end of my boxing because of all the negativity of boxing that has nothing to do with the sport, and I don't want to make that same mistake this time.
But I was happy with how much my boxing skills increased and how much better I got from boxing and I'd like to continue to get better at it.
I just need advice on how to enjoy and cherish my boxing experience with so many obstacles and negativity in the way?