Arrow tracking matters if your D&D game is about dungeon survival or emergent gameplay.
Arrow tracking doesn't matter if your D&D game is about monster fighting or storytelling, though.
An infinite quiver as a magic item makes a lot of sense, but it'd only really be valuable to the first group (and it'd be worth an Uncommon ranking so that it wasn't commonly available, and maybe have a chance of not working to add some tension to it). The second group is just going to waive the need to track arrows entirely from the get-go, making an infinite quiver a fairly redundant item that provides no real benefit.
Patching one kind of game into another kind of game via magic items is not a great idea. Better just to discuss resource management in general in the DMG and let groups decide for themselves for a particular adventure if they care about it or not.
That said, even tough D&D24 leans into monster fighting and storytelling a bit more than dungeon survival and emergent gameplay (light is a cantrip, after all), I wouldn't be surprised to find an infinite quiver in there. And it will be useless in campaigns that don't track arrows. And campaigns that DO track arrows might just not hand it out. So I don't imagine it will see much use in practice, if it's in there.