The town that I live in, Taos New Mexico, is mainly composed of folks of Spanish or American Indian descent. Anglos are a minority. However, in a county of less than 30,000 souls, there are at least 10 kilted gentlemen. I have worn a kilt out and about, day and night, formal and informal, at least 50 times in the past year. I have only had one "nice skirt" comment (from a passing woman in a bar), in all of that time. All other comments, mainly from women, have been very enthusiastic.
As has been said before, people tend to place you in a "box", and I have had my share of bagpipe and festival questions. My standard "quickie" answer as to why I'm wearing my kilt is..."because its Tuesday".
I have actually started NOT wearing a kilt to some establishments, so that they won't know what to expect when they see me walking through the door.