Sounds like the aluminum is oxidizing, probably wore the clearcoat off from friction and it's just the natural reaction that aluminum has with the air. You can polish it, but if that's what it is it will keep doing it. It actually hardens the surface of the metal.