D&D General D&D AI Fail

I guess I don’t have to worry about my job going away quite yet. This is what Twitter’s AI thingy thinks is currently happening in the industry I work in.

 

[Morrus]

But seriously, that's a humor piece written by a human, or at least cleaned up by one.

But seriously, no it's not. It's Twitter's 'Grok' bot which claims to summarise news topics.

 

[Eyes of Nine]

I mean, I'd like to play the dwarf subrace called "elf", who tend to be taller, thinner, less hirsute, and pointier ears (of course, not all dwarf-elfs etc etc). My baby dragon I know will approve

 

[Vexorg]

If you do a twitter search for "WotC" right now, lots of people are sarcastically posting claims like those. The AI seems to thing mass tweets means truth.

 

[Yaarel]

The AI seems to thing mass tweets means truth.

That is the problem in a nutshell.

Currently, AI cant tell the difference between "trending" versus true.

 

[Queer Venger]

I guess I don’t have to worry about my job going away quite yet. This is what Twitter’s AI thingy thinks is currently happening in the industry I work in.

View attachment 358923

your not out of the woods yet, ignorant people will still consume this tripe and believe it to be real

 

[Xethreau]

X markets Grok as a "humorous assistant." About X Premium

I wonder what the punch line is supposed to be exactly.

 

[Whizbang Dustyboots]

Don't knock all-dwarves until you've tried it.

 

[EzekielRaiden]

That is the problem in a nutshell.

Currently, AI cant tell the difference between "trending" versus true.

Because it can't. It is physically incapable of doing so, and unless a radical new development occurs, this will not, cannot change.

Whether or not something is factually true is part of semantic content. The meaning of the statement. LLMs and (to the best of my knowledge) all other current "AIs" have no ability whatsoever to interact with or process semantic content. They can address syntax, which can be very powerful and do some very interesting things,* but it cannot even in principle address purely semantic content like truth-value. As some researchers have put it, AIs are "confidently incorrect."

The only way to teach an AI how to avoid this would be to train it to only truly listen to trusted sources, and then it would only be as reliable as the sources it drew upon—and would have some issues if those sources are too few, as it might not have enough training data to spit out meaningful results. In theory though, you could make one designed to collate and summarize existing news reports.

*E.g. I recently learned that in the high-dimensional vector space of the tokens for GPT, if you take the token vector for "king" and add to it the vector that points from the token "male" to the token "female," you actually get relatively close to the token for "queen." That means the vector "female - male" in some sense encodes the syntactic function of gender in the English language, which is pretty cool.

 

[EzekielRaiden]

X markets Grok as a "humorous assistant." About X Premium

I wonder what the punch line is supposed to be exactly.

The fact that it is confidently wrong, I would assume.

 

[Clint_L]

But seriously, no it's not. It's Twitter's 'Grog' bot which claims to summarise news topics.

Intentional misspelling? Though, given the context and content, "Grog" bot might be apt. I believe his intelligence score is 6.