Your argument is, "If we allow X, then that will mean people ask about Y, and then Z, and then W, and then P, and then Q, and then R (etc.), so we cannot allow X."
That is a slippery slope. It's one of the most classic examples thereof: "Well if we allow kids to dance, then they'll start doing things purely for the fun of it, and playing hooky, and using drugs, and getting pregnant, and playing pool, so clearly we can't ever let the kids dance."* The slippery slope is "because we allowed X, now we have to allow everything", and you haven't actually shown that. That's precisely the problem: you are asserting a chain of--allegedly--required consequences, without actually showing that those required consequences are...required. Because I don't buy that. I don't buy that this cleric asking about the draws of a deck actually leads to an epidemic of clerics asking about their love lives or where to eat this evening. Not least because it's a 5th level spell!
*This is a reference to Footloose, and this kind of argument is quite literally part of the plot. Reverend Moore even gets the final push to fix the mess he's made of things when some of his congregants begin burning books they claim are unsafe for teens to read.