My suggestion is to wear the fez but substitute a solid or subtly patterned or striped necktie for the tartan one. I think that the tie is too busy with the kilt and the fez.

Cordially,
David