It is hard to hold your temper when it comes to people like that.

I wish I something more I could suggest that could change the mind of this fellow. I suppose that you could let him know this, that there's no need to interact with you again outside of work related issues.

Less obvious negativity towards you that way and you likely spend less good time and energy thinking anything at all about him.