It would not work at all. Sandpaper in that sense is meant to be used as an abrasive. Just because it's a lower grit doesn't mean the particles on the paper will be like what is on your sand mat. It wouldn't be like your sand mat at all or like sand at all, which generally is made up of rounded particles as opposed to sharp and jagged particles like on sand paper.
-Brandon