That sounds like a job for a subdued tweed jacket, leather sporran, polished brogues, solid colour hose, and subtly patterned shirt. I'd probably wear a tie, but be prepared to take it off depending on the level of dress of the rest of the crowd. A jaunty pocket square would finish the look nicely.