The last negative comment I got was the standard, "Nice Dress!" My retort was "Thanks! You know my wife has pants just like those!" He had no comeback and wandered away.

I really think it's the speed of the rejoinder which will throw them off. Don't give them time to think.