The very first time i was told that a wedding i was going to was casual, I went without jacket and tie (unkilted since the missus was the officiant)... Never again... even though there were other people there without ties, it just didnt feel right...

I have also worn jacket and tie to weddings where half of the people were in shorts and t-shirts, and felt far less out if place...