Exactly. I've run it both ways, with Yggsburgh as a small city/large town between Greyhawk and the castle, and simply replacing Yggsburgh entirely with Greyhawk. Either works, and notably keeping the other wilderness stuff from the Yggsburgh book still works just fine, too.
There's maybe a...