Flutterby™! : Cursor AI agent invents policy

Next unread comment / Catchup all unread comments User Account Info | Logout | XML/Pilot/etc versions | Long version (with comments) | Weblog archives | Site Map | | Browse Topics

Cursor AI agent invents policy

2025-04-18 18:15:34.396828+02 by Dan Lyke 1 comments

Company apologizes after AI support agent invents policy that causes user uproar:

On Monday, a developer using the popular AI-powered code editor Cursor noticed something strange: Switching between machines instantly logged them out, breaking a common workflow for programmers who use multiple devices. When the user contacted Cursor support, an agent named "Sam" told them it was expected behavior under a new policy. But no such policy existed, and Sam was a bot. The AI model made the policy up, sparking a wave of complaints and cancellation threats documented on Hacker News and Reddit.

Seems like maybe this started with an over-zealous anti-fraud or security measure, but LLM based support agent misrepresenting this blew it up. As Reddit user BrokenToasterOven says:

I literally just cancelled my sub and moved to AUGMENT CODE.

I was dumping like $700/wk into Cursor through work, and now we're purging it completely.

Which, ya know, maybe that user walks it back, maybe they don't, maybe they've already found the other product that they like, but this is a liability...

[ related topics: Invention and Design Current Events Work, productivity and environment Artificial Intelligence ]

comments in ascending chronological order (reverse):

#Comment Re: Cursor AI agent invents policy made: 2025-04-18 19:12:16.843021+02 by: markd

If a human made that mistake, they'd likely be fired by now. But because the AI made the mistake, I bet more money will be shoveled in.

Add your own comment:

(If anyone ever actually uses Webmention/indie-action to post here, please email me)




Format with:

(You should probably use "Text" mode: URLs will be mostly recognized and linked, _underscore quoted_ text is looked up in a glossary, _underscore quoted_ (http://xyz.pdq) becomes a link, without the link in the parenthesis it becomes a <cite> tag. All <cite>ed text will point to the Flutterby knowledge base. Two enters (ie: a blank line) gets you a new paragraph, special treatment for paragraphs that are manually indented or start with "#" (as in "#include" or "#!/usr/bin/perl"), "/* " or ">" (as in a quoted message) or look like lists, or within a paragraph you can use a number of HTML tags:

p, img, br, hr, a, sub, sup, tt, i, b, h1, h2, h3, h4, h5, h6, cite, em, strong, code, samp, kbd, pre, blockquote, address, ol, dl, ul, dt, dd, li, dir, menu, table, tr, td, th

Comment policy

We will not edit your comments. However, we may delete your comments, or cause them to be hidden behind another link, if we feel they detract from the conversation. Commercial plugs are fine, if they are relevant to the conversation, and if you don't try to pretend to be a consumer. Annoying endorsements will be deleted if you're lucky, if you're not a whole bunch of people smarter and more articulate than you will ridicule you, and we will leave such ridicule in place.

Flutterby™ is a trademark claimed by

Dan Lyke
for the web publications at www.flutterby.com and www.flutterby.net.