I think that having the Ogre in there is perfect. We encountered that Ogre also (I was DMing), and the group had little trouble with it.
First of all, the CoC description says right off that it is not a typical balanced 4e adventure and that there will be encounters where the party should...