Here's one piece of related advice:
Think of the time spent on game prep, the wiki, detailing your home-brew, etc., as unrelated to the game. Do them because you enjoy the world-building, not because you expect the players to appreciate it. It's nice if they do, but a lot of players just want to play, they don't need or want a ton of backstory and detail. Those that do want those things might feel constrained or painted into corners by your efforts to script their histories in your side stories.
Look at that time spent as time spent enjoying your hobby, not as a chore and a consequent obligation on the part of your players to respect the time you spent away from the table. You'll be a lot happier.
And welcome to ENWorld!
I had conflict with my players for the first time last session.
<snip>
I expressed my hurt at the accusation. I also shared my feelings of failure, because my main goal is to make everyone have a fantastic time (literally). I think it was very positive to express our feelings and now the negativity has been erased. I guess you need to know where they are coming from, and they need to take into account where you are coming from. Then you need to find a middle road where everyone is comfortable, including yourself.

(Dungeons & Dragons)
Rulebook featuring "high magic" options, including a host of new spells.