It's never happened to me, I already had a reputation at work as being ready to go to fists if I'm insulted, and most everyone knows better than that. I get a lot of comments going from "Nice kilt", "What tartan?" etc to "Regimental?" and "Are you wearing underwear". Now, I would get pretty mad if a guy lifted my kilt, and I'd probably crack his jaw. A lady the same way, excepting that I wasn't raised to hit women, even though Jon Wayne spanks quite a few.

However, as to people asking "the question" I was always under the impression that as a group, kilted men are usually pretty good natured about it. So I am too, I let people have their jokes, I'm not the one sitting around in too tight clothes with no air flow.