A warm hat and a good jacket...

As long as you keep your head warm and your 'core' warm, your blood flow will stay relatively good and you'll stay much more warm.

I forget the exact percentage but I saw a statistic that you lose something like 50% of your body heat through your head.