It sounds to me that if other people wear jeans then you'd be overdressed in a kilt. You could try dressing it down with walking socks, boots, and a t-shirt.