Had something similar happen. Was in a bar and I know a couple were having a muted conversation about my kilt. Don't think they were saying anything disparaging but when they saw me looking at them (not scowling) the guy stopped talking and looked away. I found it rather amusing.