I've personally never seen anyone wear the Prince Charlie without the vest, or with a straight tie. That's not to say that you couldn't do either.

Incidentally, where did you order the Agyle from? Sounds like a local place if they loaned you a P.C. Was it the Thistle and Clover?