Go for it. Assuming you go to a college with a large residential population there is NOTHING better for your social life than to get noticed in some capacity. Being the "kilted guy" can only help you with the ladies (or laddies, whatever your preference). This is not only because it is a unique and striking outfit, but because NOTHING sells confidence like a kilt. Wear it with pride, shrug off the attention it gets, own the kilt, and the rest will work itself out.

Just wear it appropiately depending on what classes you are attending and I'd check the college dress code just in case, especially if you are going regimental. Don't stress the system too much at first, let the administration get used to you for a while and be prepared to weather out any complaints.