My sensei and I had that very same discussion last week in my first night back in class for three weeks. He is of the opinion that it's not us- it's the temperature. Cold air makes our clothes shrink. I agree with him.