A sweater in New Orleans? Seems a bit warm to me. Business casual plus = shirt & tie. I think you'll be fine without a jacket or a pullover. (not you couldn't wear one if you like)