Yes - I would like the doublet very much. It's all an interesting challenge if for no other reason than what we're probably really being asked is "What would look normal" in a situation that simply isn't the norm.

I usually use that combination with a black Barathea Argyle, simply because I wouldn't want my status as clergy to clash with something very "gussy" or even somewhat militaristic.

Myenhh!