And in such cases, at least with US criminal courts, we lean on the concept of “innocent until proven guilty”
I'm not a court, nor is the "court of public opinion". The reason you are "innocent until proven guilty" in a court of law is that it can actually adversely affect you beyond your reputation: they can sanction you, fine you, arrest you, etc. The burden is much higher than because the effect is much deeper.
I don't need "innocent until proven guilty" to understand when someone is a liar: I can put together facts and simply observe their previous actions. Since I'm not a court and can't out a binding judgement on them, I can use a lesser standard... though that doesn't necessarily make it any less valid. While someone might find a loophole around a law, it doesn't mean I need not consider them a cheat, nor would that loophole invalidate that opinion.
Yeah, I think these are well-articulated reasons to be distrustful of OpenAI. That said, for me it isn't enough to get from those reasons to the belief that they are lying about reading the prompts. I could be wrong, but that in particular feels to me like a step further, and the pace of their response makes sense for me.
And gosh, I hesitate to bring this up, because I think it is unfair to Buckmaster. But it is worth noting that Kasparov's response on losing to Deep Blue was to accuse IBM of cheating. There is a sort of precedent, resonance here.
Sure, sure. But yeah, I dunno if that's the case. OpenAI has started to do this sort of "academic claim jumping" to try and build hype more recently, and this isn't the only instance of this.
This blog post points out one that I hadn't even heard of, but probably for obvious reasons: instead of trying to fight it, this professor simply published early and incomplete:
This isn’t even the first time they’ve done this
this month: they attempted to do the same thing to Dr. Julia Stadlmann, when it became clear that her work on bounded gaps between primes was nearing completion. Every analytic number theorist on the planet knows she was working on this problem, and many of them have a rough sense of the way she planned to proceed.
- 08/31: her preprint is released, and it contains the following ominous line: “As such, we believe that our method could achieve bigger improvements, but due to limited resources and limited time, we have decided to present this modest improvement as a proof of concept.”
- 09/03: OpenAI releases a preprint, following roughly her methods, lowering the bound to 186.
That sort of stuff, to me, indicates a concerted effort to overshadow academics in the field to get PR. We are only really hearing about it because Buckmaster actually stood his ground, rather than either acquiescing as some have or rushing as others. That blog post is also really good about the destructive nature of these sorts of practices on academics and the understanding of math as a whole, if anyone is interested in reading the full blog post (which I would recommend).
I also think that it'd be weird to think that the AI companies, which are desperate for PR wins to hide how bad the economics of this sort of technology currently is, would hold back any sort of resource or trick in their repertoire. I just don't see how suddenly they'd have an ethical line-in-the-sand about using their own information, and the opacity that they've created around how these things are done means that they can give denials with no actual proof that we can check ourselves; we are forced to take them at their word or not.
So it's certainly possible that they do have some sense of scruples or that they have some lines they won't cross, but I'm not really convinced of it given the "grey at best, incredibly unethical at worst" nature of academic compute achievements.