Your player is wrong if he thinks that he does not have to worry about spell components at all.
As a Cleric he must still "provide" all the components of the spells that are cast. The big difference is that for most spells the arcane versions material components are replaced by a divine focus (the characters holy symbol).
So consider Magic Weapon, Greater which has the componets "V, S, M/DF". As an Arcane spell it has Verbal, Somatic and Material (Powdered lime and carbon) Compoents. For a Cleric the material component is changed to a Divine Focus component and a Cleric does not suffer from Arcane Spell Failure chances for wearing armour (obvious as it is Arcane spell failure) when casting a spell with a Somatic component. To cast the spell the Cleric would still need to Speak (so Silence or Deafness would have an impact), Gesture (so Grapple stops this) and use their Holy Symbol.
If you look at Shield of Faith that has "Material Component: A small parchment with a bit of holy text written upon it." so the cleric must have that to cast the spell.
A Spell Component Pouch for a Cleric operates in the same way as it does for an arcane caster, "A spellcaster with a spell component pouch is assumed to have all the material components and focuses needed for spellcasting, except for those components that have a specific cost, divine focuses, and focuses that wouldn’t fit in a pouch." So have your Cleric purchase one and he is good to go for all spells that don't have a Divine Material componet with a specified cost, such as Augury.