Check out your local fabric store for "suiting" weight fabric. I think you will find it much lighter than what you want.

Another suggestion for a x-kilt is to chose an inexpensive and easy to wash fabric that does not wrinkle too bad. Hand wash or dry clean only are probably not what you are looking for?