Generally I would say stick with the same colour of leather. If you already have a brown sporran and belt, check out some shops and get a pair of brown shoes. Just not loafers, those are just wrong no matter what you wear them with

It just completes everything better. The same rule has always applied for suits (never wear brown shoes with a black suit) and casual (belt and shoes sould match), but most men didn't care.