I wear a 5 yard heavy weight wool kilt while hiking. It's high waisted and I walk with a load that's between 8 - 10 kg. The pack's hipbelt doesn't interfere with the kilt's buckles, but I don't wear a belt if I'm carrying my backpack.

No chafing, but I do wear very comfortable merino briefs.