An interesting thought, now that I think about it, does anyone other than earth humans ever actually call the stones by a name?
As far as I can remember, the first time the stones "names" are truly referenced is when Wong gives his little exposition. Maybe the collector called them by name, can't remember.
We have had alternate names for the stones, the "Aether", the "Tesseract"....which could either be reality and space in alien languages or simply just a name without such formal meaning.
Now obviously in teh comics they are very much supposed to be geared to specific powersets but if you just take the MCU story as is we only have Wong to go on that they are truly that "pigeonholed", and therefore experience would suggest that Wong and the wizards are wrong (or "wong") on that one