I would say remove them, with one caveat, it is possible with a jacket of that vintage to have discoloured over the years, if so then your black sleve under the gold will be darker than the rest, if that is the case then I would leave it.