The lift of the balloon depends on on the temperature difference and the air inside the envelope, and the air outside, and that part would actually work.

As far as oxygen goes, you’d need to have a pressurised capsule suspended under the balloon, which has been done before.