If you're dressed formally it would be inappropriate to not wear a sporran. Casually, you could wear it or not depending on your preference. I think a traditional kilt looks incomplete without a sporran, personally.