I think one of the main reasons people like the white/off-white hose is that they make the dress ghillies stand out. No other colour does that as well. I do have a pair of brown ghillies that I use for being dressed during the day. I usually wear those with lovat (green or blue) hose but it is a completely different look.

I think the boxer ghillies look silly though.