I don't think everything being magic needs to be a stumbling block, that is true with or without the Weave. I am sure there are more creative ways to handle it, but you could just say how psions access magic (the Weave or whatever you want to call it) doesn't defile, but how the arcane casters...