That's weird.
Doing some quick testing, I've found that the "permalink" link is currently tied to the page of the post. That is, the link it formed with that information within. I tested changing the page number but leaving the post the same, and the link always brought me to the first post on the indicated page. Is this what happens for you?
The "number link" link isn't a great idea for a table of contents; it only shows that post, not the whole thread.
Ideally, the permalink should contain two pieces of information; thread and post. From those it should be pulling up the page based on the user's indicated setting for posts/page (PPP). That is, the page is determined by (POST / PPP), rounded up.
(EDIT) Removed a misleading line. Rather, it seems to be determining the page based on the settings of whomever creates the link.