So, Grrol and Brapp don't have to go with you when you leave (it might make fights take longer) but they'd want to, and it's always strange in D&D when the Party is up to Very Important Things and no NPCs will help (because the game gets overloaded with too many characters).
I think they should probably go with you, but they should be used somewhat sparingly. (Like guarding the camp and carrying the canoe) As opposed to "active participants in everything that you do". Don't get me wrong, use 'em how you like. I'm happy with anything that seems to make sense, story-wise.
How do you all feel about it?