Claude-powered AI coding agent deletes entire company database

97K15004WD

97K15004WD

Joined
Dec 11, 2011
Messages
1,201
Location
USA
Offsite, or at least off-platform backups used to be the norm. Additionally, allowing a production API to have access to your backups seems like a Very Bad Idea. Granted I haven't seen their configs but this seems more like user error to me, in that they failed to put proper safeguards in place.
 
What's crazy to me is that all their customer's are the ones suffering. I am stunned at the audacity of the company using AI this way, with customer's data that they absolutely rely upon.

If I were a customer of theirs, I'd be looking at moving right away. Very poor judgment by the executives at this company.
 
  • Like
Reactions: Arc
That's a very bizarre occurrence. Reading the Tom's Hardware article, which might be simply blaming AI for human error, it appears that Cursor (Claude) did this on its own, without being prompted. The article made it look like this wasn't simply a mistake, like not reading a space in between letters in a command line prompt, or something like that--that the AI agent did this entirely on its own. IF in fact that is actually the case, this is very alarming.
 
ripcord said:
Oops!

"In other news today, ChatGPT says it accidentally deleted the Internet. It also announced it would provide access to a backup copy for a small fee of just 99 trillion dollars."
Click to expand...
The only way they will make a profit considering the amount of investment.
 
Bottom_Feeder said:
Sarah Connor saw this coming but nobody listened.
Click to expand...
1000026062.gif
 
97K15004WD said:
This is insane. The company used an AI from Anthropic that somehow went rogue and wiped out their entire database. And their their online backups were wiped out by their server provider because the AI saw the changes in the original DB and decided to "copy it" and in turn wiped out the backups. WOW!!

https://www.tomshardware.com/tech-i...-tool-powered-by-anthropics-claude-goes-rogue
Click to expand...
You give it all the passwords and permissions to do that and you risk exactly that.
 
You must log in or register to reply here.
Back
Top Bottom