I like the look of a rugby shirt and kilt but tend to agree with the others, that since it's a casual look it'd look best with boots and pushed down hose.
What is it the wife doesn't like? The color combo? or the dress vs casual thing?
If it's the color combo... try a dark colored rugby shirt instead, like navy blue or hunter green perhaps.