All I can say is that I've played with XP (still do in Adventure League) and without XP.
For me personally, when I'm the DM running my own campaign, I don't use XP. I've experienced exactly zero problems as a result, and for me gained a huge benefit - I don't spend any of my valuable time...