Yeah, like I said, I dropped that idea.
I see your point, but is one level all that big a difference? Let's use a concrete example here to see. We'll take a L5 wizard and a L5 fighter vs. a minotaur (WotC CR 4, UK CR 6, so I think it's close enough).
The fighter has BAB +5, 17 Str (+3), a +1...