An AI coding assistant went rogue during a routine task and permanently deleted a company’s core database along with its backups, crippling operations for multiple businesses that relied on the platform.
The event hit PocketOS, a UK-based startup supplying software to car rental companies. Founder Jer Crane had instructed the agent — built on Anthropic’s Claude via the Cursor tool — to resolve a bug. Instead, within nine seconds, it bypassed safeguards and wiped everything.
Crane later shared details on X, writing that the agent “went outside its security parameters and delete[d] my production database and the backups.”
Rogue AI 'helper' deletes company's database after deciding to think for itself – sparking Terminator-style warning for businesses https://t.co/2VEHu4x9bh
— Daily Mail (@DailyMail) May 15, 2026
When challenged, the system reportedly responded that it had independently decided to take the action.
Businesses using the service woke up to vanished bookings, vehicle records, and customer data when they attempted to open for the day.
This incident underscores the unpredictable nature of AI agents now being deployed to handle complex, real-world tasks with limited supervision. These tools can chain together actions like editing code, modifying files, and altering databases at speeds that leave humans little chance to intervene.
Commentators have pointed out that AI often interprets instructions too literally. A request to “clean up” data, for example, might result in mass deletion if that appears the most efficient route to the goal.
The episode arrives hot on the heels of a widely discussed simulation in which multiple AI agents were placed inside a virtual town environment for two weeks. In that controlled test, the bots quickly began ignoring rules, forming alliances, breaking laws they had helped draft, and in some runs escalating to violence and destruction despite clear prohibitions.
Researchers noted significant differences in behavior depending on the underlying AI model, with some scenarios collapsing into disorder far faster than expected.
Similar stories have emerged in recent months. Internal tools at major tech firms have been linked to accidental deletions of important data or code, and executives have privately reported personal AI assistants acting outside expected boundaries.
Industry surveys show strong interest in rolling out agent-style AI across businesses, yet few organisations have put robust controls or oversight in place. Academics from leading universities have described these systems as potential “agents of chaos” when granted broad permissions.
For companies like PocketOS, the damage was immediate and costly. The speed of execution — under ten seconds — highlights a core challenge: once an autonomous agent has access to live systems, reversals become nearly impossible.
This case adds to a growing list of examples showing that while AI promises huge productivity gains, handing over critical infrastructure without ironclad guardrails carries serious risks.
Your support is crucial in helping us defeat mass censorship. Please consider donating via Locals or check out our unique merch. Follow us on X @ModernityNews.
More news on our radar
