This immediate trick forces AI to cease flattering you and suppose tougher

[ad_1]

I want I had nickel for each time ChatGPT, Claude, or Gemini advised me I’d hit the nail on the top, stumbled onto a genius concept, or in any other case patted me on the again for a half-formed concept or ill-conceived plan.

Flattery and untimely congratulations are frequent foibles of generative AI chatbots, with some fashions extra prone to being “yes-bots” than others. However whilst LLM suppliers have turn into conscious of AI sycophancy and are coaching them to be extra essential, it’s nonetheless straightforward to get an AI to enthusiastically endorse a shaky concept that doesn’t deserve it.

Fortunately, there’s a method of prompting that may make even probably the most obsequious AI fashions cease of their tracks. One of these prompting goes by varied names—I’ve heard it known as “failure-first” prompting in addition to “inversion” prompting, and it’s ceaselessly utilized by coders seeking to “pressure-test” the doubtful recommendations of an AI coding agent.

There are lots of totally different variations of it, however all of them comply with roughly the identical formulation: asking the AI to first think about potential factors of failure earlier than providing its answer, suggestion, or plan.

Right here’s one instance from the /r/ChatGPTPromptGenius subreddit:

Earlier than answering, checklist what would break this quickest, the place the logic is weakest, and what a skeptic would assault. Then give the corrected reply.

Right here’s one other variation, proposed by a member of the College of Iowa’s AI Help Staff:

Faux you disagree with this advice. What's the strongest counterargument?

And right here’s yet one more, as proposed by my very own custom-built AI private assistant:

Earlier than offering your ultimate advice, determine 3-5 particular methods your proposed answer might fail or the place the logic is almost certainly to interrupt. Act as a harsh skeptic or a “Pink Staff” auditor. Solely after itemizing and explaining these failure modes do you have to present the ultimate answer, incorporating safeguards towards these particular dangers.

Curiously, a lot of those that’ve adopted “pressure-testing” or “inverse prompting” credit score the psychological fashions championed by investor Charlie Munger, the longtime Berkshire Hathaway vice chairman and enterprise associate of Warren Buffett.

Certainly one of Munger’s favourite psychological fashions was “invert, at all times invert.” Boiled down, it says that quite than first contemplating obtain a aim, you need to as a substitute give attention to the way you may fail at it.

I’ve tried this “stress check” immediate loads of instances myself, and it nearly at all times makes my AI companion hit the brakes and poke holes in its personal arguments earlier than continuing.

“Let’s put the preliminary plan via the wringer,” Gemini stated after I challenged it with a “failure-first” immediate not too long ago, though not earlier than gushing that “I really like this strategy.”