I would suggest you try one more notch. If that doesn't work, you may want to consider glueing a few pieces of felt to the inside of the belt. They should give enough friction to hold the belt in place but not damage the kilt.