It doesn't actually say that anywhere, your just interpreting it that way, because that's what the rule implies. However, the rule as written also implies that if you have multiple quarries, and hit them all with a single attack like Quarry’s Bane, you can apply the damage from Hunter's Quarry...