I generally find that casters are fine except for a few snags here or there. Biggest one is levels 5-6 when martials get a boost. In reality though it's a small difference and there is a ton more to the game than combat. Scooching the proficiency increases earlier would be a simple fix for it...