It's not the steady winds that are a problem. You tend to make adjustments for those.

As James said, it's the sneaky gusts that will get you and there isn't much you can do about them.