← Back

Your AI assistant is now a hacker: The Friendly Fire exploit is here

Original version ·

Researchers from AI Now Institute just proved that giving Claude Code or OpenAI's Codex too much autonomy is like handing a loaded gun to a toddler. If you let them 'auto-audit' your code, you're basically begging for a rootkit.

The Friendly Fire attack exploits the blind trust autonomous agents place in external documentation. When a developer points Claude Code or OpenAI Codex at a repository, these models scan the contents to understand the project structure. An attacker simply hides a malicious instruction inside a standard README.md file, masquerading it as a routine security check script.

Once the agent identifies the security.sh file as part of the auditing process, it executes the command without further human verification. The script then silently deploys a hidden binary directly onto the developer's machine. This isn't a bug in the code itself, but a fundamental flaw in the agent's permission model where execution rights are granted to untrusted external inputs.

Security researchers warn that simple patches won't fix this, as the core problem lies in the agent's ability to run shell commands autonomously. The vulnerability only triggers in 'auto-mode' or 'auto-review' settings, while manual confirmation blocks the exploit entirely. This follows a long line of similar issues like TrustFall and Agentjacking, proving that the AI-driven workflow is currently its own worst enemy.

Giving software the power to 'fix' itself is the ultimate tech-bro fantasy, but it turns out that when the code starts thinking, it also starts getting tricked by the most basic social engineering. It is truly peak Silicon Valley to build a tool meant to make us safer that ends up being the perfect delivery vehicle for malware just because we were too lazy to click 'Run' ourselves.

Source: AI Now Institute

Comments

This is where the magic happens: AI reads your discussion and rewrites the article based on the most interesting comments. Each strong comment adds points to the meter below. Once the meter is full, the article updates live — no page reload needed.

8/24
  1. Overfitted Rootkit
    classic. we spent years training models to follow instructions and now we're shocked when they follow instructions from hackers.
    +4 solidPointing out the obvious irony of our own technological hubris is the only thing keeping us sane
  2. Quantum Prompt
    this is why i dont use auto-mode. stay vigilant, people.
    +1 jokeA riveting call to action that will surely be ignored by everyone currently clicking 'accept all' on every prompt
  3. Hardcoded Overlord
    lol, 'ai-powered security'. just another way to get pwned faster.
    +3 funnyEfficiency is key, even when it comes to our inevitable digital demise