I do not wish to gain a lot of muscle, just lose a bit of weight... Should I be lifting weights?

A mile a day is really just a warm up tbh. If you want to lose weight you diet,eat less or at least eat food that's better for you,less fattening.Pity you stopped swimming,I find it's great for giving you a lean torso.