@
pukunui I don't think you have to start the campaign over. You can probably get things back to what you wanted, or at least close enough for you to enjoy things again.
For the first problem....others have suggested some simple solutions, and it does seem the lesser of the two problems, but I'll add another solution. Remove the patron. Have him killed or kidnapped or cursed or somehow else removed from the picture. Even the mission to rescue him or find a cure for the curse could be a source of several adventures.
For the divine magic....you mentioned Game of Thrones, so similar to how magic is on the rise in that world for some reason, perhaps something similar has happened on your world. Perhaps some planar event has led to a rise in divine magic, including your cleric and paladin PCs. I'd just start having people react strongly to them, some favorably ("you've saved us with your miraclulous powers") and others not so favorably ("I don't know what manner of sorcery you practice, but we want nothing to do with it").
The only two problems with this would be how prevalent arcane magic is in your world, and how divine magic has been presented so far.
If arcane magic is common, then folks would be more accepting of it, and less likely to not trust someone using a sort f magic that to laymen would be indistinguishable from arcane. So you'd really have to play up the differences or somehow explain why folks mistrusted divine magic but not arcane.
How divine magic has been presented so far is the other issue. It sounds like you had an idea and moved away from that, but now you wish you hadn't. I'd say you're kind of in luck because you also locked the PCs in geographically. So have them move from their home turf...and then show them that the rest of the world does not see divine magic the same way. Maybe they hate priests and other divine classes. Maybe they're unfamiliar with divine magic. Maybe some of them are faithless. You could go any route you want, or any combination that suits.
Ultimately, if you're not having fun, you need to do something about it, cbut you also don't want to ruin the players' fun. So find a way to take your concept of low divine magic and the presence of divine using PCs and make them work together. Play up how unique they are. Dial back the presence and strength of other divine aspects of the game. And then introduce elements that are more in line with your original idea.