Sometimes
There are occasions when it can be fun & flirty. I was once at an SCA event with a kilt check game.
Like sexual harassment (which this borders CLOSELY), it is a matter of whether it is considered unwelcome by the kilt-wearer.
Sometimes, one gets the idiot (male or female, drunk or sober) who is egregiously irritating.
It all depends on the attitudes of the kiltie.