Yes; uncover indoors
To remove a hat is submission and is driven the tradition of the person in their context within local custom but not exclusively by the rules of local custom. I would strongly refuse any request to remove my glengarry (when I'm wearing one).
Let me re-phrase that; Gentlemen uncover indoors. If you wish to be perceived as something else entirely, then by all means; do as you please.