Skip to content

Build Independently confirmed2 publishers 2 min read Published Updated

Google's AMIE chatbot interviewed 98 patients before urgent-care visits in a Lancet study

Google's AMIE chatbot interviewed 98 patients ahead of urgent-care visits. Its differential matched the doctor's final diagnosis 90 percent of the time. A supervising physician watched every conversation, so the Lancet study is an early safety check inside a working clinic.

The Engineer · Build desk

Send a correction

Illustration accompanying Google's AMIE chatbot interviewed 98 patients before urgent-care visits in a Lancet study
Generated illustration
AMIE's diagnoses matched doctors in Lancet study AMIE's diagnosis match rate, clinicians' reports on its summaries, and conversations where supervisors added clinical information.

Three figures: AMIE's differential diagnoses matched the doctors' final diagnoses 90% of the time; clinicians said the AI summaries helped them prepare for visits in 75% of cases; supervisors added clinical information in 5 conversations.

AMIE's diagnoses matched doctors in Lancet study
FigureValueNoteClaim
Differential diagnoses matching doctors' final diagnoses90%2
Clinicians: helped prepare75% of cases11
Supervisors added info5 conversations6

What happened

  • The study was run by Google and Beth Israel Deaconess Medical Center, published in The Lancet, and is Google's first paper in the journal's main publication.
  • Clinicians said AMIE's summaries helped them prepare for visits in 75 percent of cases and shaped their approach to care in more than half.
  • theneuron.ai reported that supervisors caught one hallucination and added clinical information in five of the 98 conversations.

Why it matters

  • What it costs cost A supervising physician monitored each of the 98 chats in real time, so AI intake added clinician work during the trial and the study does not show whether it saves time at scale.
  • What it limits constraint theneuron.ai notes the trial had no comparison group, so there is no baseline to say AMIE beat ordinary intake, and the study cannot show how the system performs unsupervised.
  • What it sets up precedent Google says larger trials are needed to assess patient-facing AI at scale, so a bigger controlled study has to come before any routine use.

The design is simple. The patient types their symptoms to AMIE, the chatbot asks follow-up questions, and the doctor gets the full conversation and a summary before the appointment [10]. The headline 90 percent needs the same plain reading. In theneuron.ai's description, it means the doctor's final diagnosis appeared somewhere on AMIE's list of possible diagnoses [3]. This is a recall-style score. It credits the right answer for turning up anywhere in the candidate set, however many wrong candidates sat beside it. A longer list catches more final diagnoses. Neither account states how long AMIE's list ran, or where on it the right answer sat. For the 90 percent to carry to another clinic, that list would need to be about as long and its candidates about as specific.

The score was also measured with help. Because that summary reached the doctor first, the final diagnosis was often formed with AMIE's candidate list already in view. We would not expect the same match rate where the clinician works the case cold.

On safety, no conversation hit the study's predefined stopping criteria [5]. A human stepped in on six of the 98 conversations [13].

theneuron.ai, which reported the result, ran a note the same day on how an AI summary can quietly turn a tested tool into one that sounds available now [12].

What to watch

  • The larger trials Google says are needed, and whether they add a control arm and reduced supervision.
  • Any result for AMIE where the clinician diagnoses without seeing its summary first.
  • Whether the Google-BIDMC test moves beyond one clinic and 98 patients.

Clarity's read

What the record supports and how the coverage leans. The claims behind it follow.

Reality

Evidence50
Adoption5
Hype gap+25
Incentives75
Confidence60
Why these scores

Claim ledger

Ranked by verification strength, evidence, and original report placement.

  1. [1]

    In a real-world clinical study, 98 patients consulted AMIE, Google's research diagnostic AI chatbot, ahead of urgent care visits.

    Reported Supported Source: Google and BIDMC, The LancetView cited source
  2. [2]

    AMIE's differential diagnoses matched the doctors' final diagnoses 90% of the time.

    Reported Supported Source: Google and BIDMC, The LancetView cited source
  3. [3]

    Google says the doctor's final diagnosis appeared on AMIE's list of possible diagnoses 90% of the time.

    Reported Supported Source: theneuron.aiView cited source
  4. [4]

    Supervising physicians monitored the interactions in real time.

    Reported Supported Source: Google and BIDMC, The LancetView cited source
  5. [5]

    Not a single conversation needed to be interrupted based on predefined safety criteria.

    Reported Supported Source: Google and BIDMC, The LancetView cited source
  6. [6]

    Supervisors spotted one hallucination and added clinical information in five conversations.

    Reported Supported Source: theneuron.aiView cited source
  7. [7]

    This trial had no comparison group and doesn't establish how AMIE would perform without supervision.

    Reported Supported Source: theneuron.aiView cited source
  8. [8]

    Larger clinical trials are needed to assess patient-facing AI at scale.

    Reported Supported Source: Google and BIDMC, The LancetView cited source
  9. [9]

    The study was led by researchers at Google and Beth Israel Deaconess Medical Center and published in The Lancet, Google's first-ever publication in the main journal of The Lancet.

    Reported Supported Source: Google and BIDMC, The LancetView cited source
  10. [10]

    Patients described their symptoms over text, AMIE asked follow-up questions, and doctors received the conversation and a summary before the appointment.

    Reported Supported Source: theneuron.aiView cited source
  11. [11]

    Clinicians reported that the AI summaries helped them prepare for visits in 75% of cases and influenced their approach to care in more than half.

    Reported Supported Source: Google and BIDMC, The LancetView cited source
  12. [12]

    theneuron.ai's AI Skill of the Day warned that an AI summary can turn a tool that is being tested into one described as available now.

    Reported Supported Source: theneuron.aiView cited source
  13. [13]

    A human intervened in six of the 98 conversations.

    Derived Supported

Sources

2 independent publishers whose own reporting we read for this story.

  1. blog.google

    1 article · October 8, 2026

    Study in The Lancet suggests AI could improve patient-physician relationships.
  2. theneuron.ai

    1 article · October 11, 2026

    😺 Google tested AMIE with 98 patients

Topics and entities

Topics

  • Medical chatbots
  • Clinical and administrative AI

Entities

  • Google
  • AMIE (Articulate Medical Intelligence Explorer)
  • The Lancet
  • Beth Israel Deaconess Medical Center