Andrew is spot on about man made wind tunnels, I find it difficult in the city, but on the beach or hiking in the mountains...not a problems, well, sometimes up mountains.

If I'm going to the city on a windy day I'll wear an 8 yard kilt.
The heavier the kilt, the more it behaves. 4 yard PV is as light as they get. My suggestion: make our next kilt an 8 yard, even in PV, it will be fine.