Oxygen is common in the universe. You can see the evidence of oxygen on the surface of other planets even without a telescope. Take a look at Mars in the sky. The distinctive red colour of rocks on the surface of Mars is caused by iron minerals oxidising (rusting) in the presence of oxygen.