I've done it. Many of our customers have done it. Guys in the UK wear Soccer / Football or Rugby jerseys with it. Some people buy a tartan specifically to match with their jersey.

Here's an example of a model on our site wearing his kilt and a flyers jersey for our photo shoot: