Personally, I'd probably go Sorcerer instead of Warlock, since that seems to be the class that is meant to model inborn magic. But there might be some good stuff in the Warlock to borrow when building the new Sorcerer subclass.
Cool take on what the warlock's pact represents, though.