I think I'd house rule something like this.
You can crawl at 1/4 your speed. Just like climbing. Actually its harder to crawl than it is to climb which doesn't make any sense. Sure you get at AoO on you if you climb without a climb speed but so does crawling. So if you happen to be prone...