If the DM has something against a class or power source I think there're deeper issues.
If, on the other hand, the DM thinks it's good flavor for, say, Dwarves to mistrust wizards (-2), and Elves to be inclined more favorably towards wizards (+2), then I don't think that's too weird.