I used to carve soapstone as a kid and used little scraps of that to mark fabric. It worked great, leaving a little powder that would rub off after a few swipes. I was careful not to use a piece of soapstaone that had hard impurities in it.

Abax