Artificial Intelligence

[PopeBeanie]

Especially for @RegTheFronkeyFarmer, this relatively new security threat (iirc) can manifest when AI has been given access to (e.g.) a web page that has an exploit embedded into the html. It sounds crazy, but there is a design issue using current LLMs that causes the AI to presume that it has encountered a valid prompt, that looks like it’s coming from the user of the AI.

It’s complicated, and I barely understand maybe 5% of what they’re talking about, but I’m sure (from personal experience) that they know what they’re talking about. I think the news about this potential exploit will be significant, and the problem itself will difficult to remedy, at least because some of how AI works at its deepest level has been unexpected, and mysterious even to AI designers.

[Author]

Posts