One of the most enjoyable parts of renovating and old bike is cleaning the chrome plated steel parts of the bicycle.
Basically, the rust is iron oxide. It can be removed with a bit of aluminum foil.