I, also, wore my in the company of veterans, and explaining my tartan, was my clan... US Marine Corps Leatherneck, they appreciated the kilt. I have worn my kilt in the presence of some of my friends, who are the 1% biker types, they gave me a bit of grief, but also acknowledge an admiration of sorts, to me wearing it.. "it takes a set" to wear it.. especially around them...LOL.. most of them are Vets, and respect the Leatherneck tartan for what it represents..
Yeah, it going to happen. People who know you, will mess with you, but its usually in good nature.. you laugh it off, and move on.. its what we do. They respect you, for who you are, they probably respect you for honoring your heritage, or just wanting to wear the kilt.. It takes a certain type of personality to wear the kilt, in the non kilt wearing world... and that is the same one thats predominate, in the military, and even the biker community..

Remember.. we dance to the beat of our own drum... and pipes,too.