For a function off that sort, I would say that the sweater is by far the way to go. Save the shirt for an even less formal occassion.