I'm not sure about your town but around here I think most people would see a kilt and think one of two things:
1. Oh cool, look a kilt.
2. Hey look he's wearing a skirt. (must be said in a redneck accent)
Most people wouldn't know the difference in kilts to critique it. I have worn my SK out in public before and I'm quite comfortable with it. (I always wear a sporran with it). Now Sean Connery might think "oh my, what kilted social faux pas." But most people probably wouldn't know, or care, about the difference in kilts.

I would say if you are comfortable in it, wear it. I don't know anything about Utilikilts, I just never liked the looks of them personally. Although they certainly look heavier. (they need plaid)