Not too much white and white isn't especially feminine.

It just happens to be that most Highland dancers are female and wear white "dance/dress" tartans.

Go for it if you like it.