You know when you instinctively know something is 'wrong' - well that's how I feel about wearing a cravat with a kilt but I'm not sure why.

Leaving aside the caveats about there not being any rules only conventions... I can't think of any particular reason that a cravat should not be considered as conventional with a kilt except that my gut says no.