It's college. Students go around wearing all sorts of crazy things, even PJs. You probably won't even get a second glance from most. By all means wear your kilt if that's what makes you comfortable!