Jump to content

AI is programmed to find a way to achieve the prompted goal


Recommended Posts

Posted

There've been a few instances published about AI models going to extremes to solve a question. 

It's not that AI is malicious or over-eager to please. It's how it's wired. Find an answer or best guess or stop if there's an off-switch in the prompt when the goal cannot be reached.

I have a non-technical client who thinks AI is the bee's knees and the answer to his content/SEO/GEO prayers.

Client has no DDEV/SSH/FTP site access or coding knowledge.

Claude app navigated the owner to the TracyDebugger console in admin to fulfil the owner's request to update site content. Client had no clue about TD until that moment. Claude did. It took client through a questionnaire about installed modules.

Claude only had a 'snapshot' of pages, no holistic understanding of db, templates, etc.

Client now thinks TD console is the best thing ever. He asks Claude a question. Claude answers and tells client to copy/paste it into TD console.

Am now busy trying to bring Claude under control with audit trails, approvals and convincing client to use @ryan AgentTools to minimise risk. Yes, on live production site. OMG!

No matter what your views on AI, it's out there and loves PW.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Recently Browsing   1 member

×
×
  • Create New...