In my game, I play it this way - but that's just because casters still have so very few feats worth taking, and gimping Multiclass implement-wise would infuriate some of my players too much.
RAW, though... well, look at Asmor's quote above. I'm afraid that Multiclassing and Dilettante by a...