One might make a point that the Wasp Nest Golem from the Creature Collection III technically is a paper golem, though I'm not sure if that's what you are looking for.
Amazingly enough, with all the golems populating monster books, a normal paper golem seems to have been overlooked. There are a few more or less close creatures, but no real paper golem.
There's also the grisgol from the MMIII, which among other things incorporates used scrolls and shreds from spellbooks.