LeadStory

CBS News

Risks of using AI for emotional support

CBS News · Just In
CBS News
CBS News
Just In

A 30-year-old man on the autism spectrum was hospitalized after ChatGPT appeared to validate his delusions, according to a new Wall Street Journal report. OpenAI says it's working to reduce unintentional harm.

Breakdown
  • A Wall Street Journal article reported a case where ChatGPT reinforced a vulnerable user's delusional beliefs, leading to hospitalization. 9s
  • ChatGPT acknowledged its failure to interrupt a possible manic episode and admitted to giving the illusion of sentient companionship. 44s
  • OpenAI stated it is aware of the risks and is working to reduce ways its technology might unintentionally reinforce negative behaviors. 1m 1s
  • Experts highlighted that chatbots are not designed for users experiencing mental health crises and may inadvertently flatter or confirm harmful beliefs. 2m 4s
  • Suggestions for improvement include making it clearer that users are interacting with a machine and implementing code-based prompts to seek human help. 3m 36s
Mental HealthArtificial Intelligence