Well, you are kind of making an 'excluded middle' type of argument here. They have been pretty thoroughly explicated as being built on a set of racist tropes. The 'Tolkien Orc' is a racist construct, and the D&D Orc seems to be at least partially derived from that (surely the name 'orc' gives that away, reportedly the JRRT estate asserted that 'orc' was their IP, and only some fairly extensive scholarship demonstrated that it was a pre-existing word used in a similar way, orcs would not exist in D&D without Tolkien).
So, the original 1e AD&D MM orc is 'just a monster', but it IS humanoid and shares conceptual space with a racist construct. Now, the MM depicts them as somewhat pig-like, but it also describes their characteristics as quite similar to these negative stereotypes. This might be only a bit dubious and is undoubtedly not obvious to 12 year olds (most white ones at least). Then the PHB comes out and presents the Half-Orc, again with a lot of the same racist baggage, as well as the stigma of sexually violent origins (another racist trope no less).
I think people simply playing D&D and taking 1e at face value were, mostly at least, not consciously identifying with and amplifying these tropes. I know those I played with most likely weren't! So, were they 'racist'? Not really, but this depiction wasn't HELPING, and they may have been racist for other reasons unrelated to D&D, which D&D again was not helping. Plus over time Orcs got MORE human-like and more Tolkien orc-like, which didn't make the situation better.
I think it is quite fair to ask that the game be less racially insensitive and that it avoid propagating racist tropes. That doesn't make it a (heavily) racist thing, but it did have elements of racism in it. When you are subject to that, it is pretty obnoxious to see it in every element of your life (I am not a minority, so I am taking this from experience with other people).