posted in Technology
Microsoft confirms an AI worm is propagating through Copilot and other MS apps | CSO Online
www.csoonline.com/article/4203630/microsoft-confirms-an-ai-worm-is-propagating-through-copilot-and-other-ms-apps.html
CSO OnlineMicrosoft confirms an AI worm is propagating through Copilot and other MS appsAlthough there are a few ways to mitigate the risk, the only way to block it is to get AI to differentiate instructions from data, which is impossible today.Replying to @FoxtrotDeltaTango@sh.itjust.works
The tl;dr:
Prompt inject a malicious instruction in a word document that instructs the AI to copy this instruction to other documents as part of the payload.
Dumb user downloads and opens the document with copilot enabled, abd ignores the large suspicious white blank page that totally doesnt look like a hidden giant injection attack.
Thats it pretty much it.
Copilot will get injection attacked because the prompt is super huge and at the end of the document, so its prior instructions start to fuzzy out.
Then it’ll go “okey doke” and start copying the prompt injection attack payload to a bunch of other documents.
The fix is stupid simple… copilot should just be prompting the user for permission if it ever edits a file other than the one that is open. Im surprised that isnt already the case…?
It certainly is already the case for copilot in vscode.
Replying to @pixxelkick@lemmy.world
copilot should just be prompting the user for permission if it ever edits a file other than the one that is open. Im surprised that isnt already the case…?
That can’t be done or they would be burying the “agentic AI” thing that has been the goal and marketing thing for the last years.
Independent actions by copilot on behalf of the user without the users knowledge is the entire point.
Replying to @it_depends_man@lemmy.world
And I couldn’t want anything less for my computers.