Navy dress blues were famous for getting fuzz balls, especially when they were washed onboard ship. No dry cleaning plants on ships in those days. Gentle and very careful use of a safety razor was the solution. I would guess that with today's multi-bladed safety razors it would be much easier.

Mike