Well, I do find that a kilt can 'settle' a bit, but a few hours wear seems to do the job and the difference isn't anywhere near what you're describing.

Who made the kilt? If you're missing a stabiliser then the pleats could be giving way at the waist line or something.

I would certainly advise against 'adjusting' your actual measurements. that's only likely to mess up your kiltmaker.