Do you, by chance, have moth balls in the closet?

Maybe you are associating the moth ball smell with wool?