Never really thought of it that way, but you are right. You shouldn't be able to tell in a situation like this.
I have to agree with Ironwolf though. You, as a wizard, may not be able to cast it but certainly at some point in your wizarding training you would have heard of or seen another...