Nope. Never. As I only wear kilts as a reminder of family affiliation and history there would be nothing negative anyone could say. In fact friends, especially those Scottish, thank me when I wear my kilts.

I could see getting comments (negative or not-so-positive) if family or friends think it's a fad or something done for attention or "to be different".