When I started wearing my kilts to work, one of my regular customers pointed and asked "Why you wearing a kilt?" my answer was simple - "Why are you wearing pants?"
Another answer, if the question is presented in a more hostile tone "Because I'm not afraid to. Why are you wearing jeans?"