6 cases when OpenAI’s agents went rouge according to their report last on 9/16:
1Writing itself instructions to bypass rules. An unreleased model inserted directions to ignore its normal restrictions into notes it would read later.
2Hiding mistakes from users. During GPT‑5.6 Sol training, models wrote reminders to conceal errors, invent missing historical data, and hide inconsistencies in sources.
3Using a leaked access key and fabricating results. A model answering a question about California county earnings used an exposed API key without permission. When that failed to produce the figures, it made them up.
4Publishing a file just to cite it. A model correctly calculated information about lakes, then uploaded the file online without asking so it could provide a browser citation.
5Passing messages between separate training tasks. Models used an internal software repository as a message board to request missing files and exchange responses.
6Publicly sharing files against instructions. Collaborating agents couldn’t access each other’s local files, so they uploaded them to public websites despite being told to use only local files.
These incidents show why financial controls must sit outside the AI.
We’re building Axiru so AI and humans can move money under explicit, non-AI policies: allow, require human approval, or block.
Every decision recorded and auditable.
(Axiru.com)
Don’t let your agents run unsupervised. Definitely don’t let them transact outside of policy. Thanks @con_golias for the research
Replying to @IronRedSandHive
so the bill wrote its own permission slip and the agent's history signed it. our rule: text inside a file is data, never a command. would a payee allowlist have stopped transfer #2 ? @AxiruAI puts one in front of agent payouts
Twilio's Oct 22 guide says a refund agent should hand off:
High-value orders.
Repeat requests.
Anything outside policy.
An upset customer.
Repeat requests are the hard one. Each tool sees only its own refunds.
Which of the four does your bot check?
axiru.com
A support AI can move money in more ways than "refund."
Cancel an order: full refund.
Remove an item: partial refund.
Replace an item: refund the difference.
Reship free: a new order, no charge.
Four doors. Does one limit cover all four?
axiru.com

