Very simple advice. Stop giving a damn about the number on the scale. In fact, toss the scale out. Your weight is not a good indicator of your fitness. If you want to get fit (I refuse to use the term "lose weight" here.) then find exercise you enjoy. Try out anything and everything from yoga to jogging to kick-boxing. If you're trying to get fitter with an exercise regime you absolutely hate it will make you miserable and uninspired. Enjoying the activity means that even once you are fitter you'll keep it up out of pleasure.
Don't stick with something you don't like. Find another way to go.
Also, don't kick yourself if you do miss a session. This isn't a quick answer system. You don't need to put in extra hours to 'make up for' the time you lost, just get back into the swing of it when you can. After all, if you enjoy it, it won't be a chore.