Large Language Models & Generative AI in Medicine

LLMs and generative AI are transforming clinical documentation, medical education, patient communication, and drug design — bringing flexible reasoning and content generation capabilities to medicine.

Updated Mar 2026Based on 48 documented implementationsSources: vendor reports, public filings, verified submissions
48
Case Studies
4
Vendors
Hospital & Health System
Top Industry
Drug Discovery & Development
Top Use Case

Industries Distribution

Hospital & Health System
20
Pharmaceutical & Life Science
19
Mental & Behavioral Health
6
Imaging & Radiology
2
Dental & Oral Health
1

What is AI Large Language Models & Generative AI in Medicine?

Large language models represent the most rapid adoption wave in medical AI history. Within months of GPT-4's release, every major health system and pharma company was evaluating LLM applications. The technology's versatility — understanding context, generating text, reasoning about complex scenarios, and following nuanced instructions — makes it applicable across clinical, operational, and research domains in ways that task-specific AI models cannot match. Medical-specific LLMs (Med-PaLM, BioGPT, ClinicalCamel) are tuned for healthcare accuracy, while general LLMs are being deployed through healthcare-specific platforms with guardrails.

Ambient clinical documentation is the killer application for LLMs in healthcare. Abridge and Nuance DAX Copilot use LLMs to listen to physician-patient conversations and generate structured clinical notes — understanding medical context, clinical reasoning, and documentation requirements. Abridge has been named Best in KLAS for two consecutive years, deployed at Sharp HealthCare, MaineHealth, and BILH. Merck's GPTeal initiative applies generative AI across pharmaceutical R&D. Bristol Myers Squibb partnered with Accenture to deploy GenAI in drug development. Epic, the dominant EHR vendor, is integrating LLM capabilities directly into clinical workflows used by over 250 million patients.

Generative AI is also transforming medical education, patient communication, and administrative operations. LLMs generate patient-friendly discharge instructions, translate complex medical information into accessible language, and draft prior authorization appeals with clinical justification. In research, generative AI assists with literature review, protocol development, and manuscript preparation. Drug design uses generative models to propose novel molecular structures and protein sequences. The primary challenges are hallucination (generating plausible but incorrect medical information), reliability (consistent performance across edge cases), and governance (ensuring appropriate oversight for clinical applications). Healthcare organizations are establishing AI governance frameworks that distinguish high-risk clinical LLM uses from lower-risk administrative applications, applying proportionate oversight to each.

What Large Language Models & Generative AI Delivers

  • Generate clinical documentation from natural conversation with contextual understanding that captures medical reasoning, not just keywords
  • Draft patient communications, discharge instructions, and prior authorization appeals in clear, accessible language
  • Accelerate drug discovery by generating novel molecular structures and protein sequences optimized for desired therapeutic properties
  • Support clinical reasoning with LLMs that generate differential diagnoses, summarize complex cases, and surface relevant evidence
  • Automate administrative tasks — medical coding suggestions, referral letters, chart summarization — with flexible language understanding

Large Language Models & Generative AI: Common Questions

The primary clinical applications are: ambient documentation (Abridge, Nuance DAX converting conversations to notes), clinical summarization (condensing complex patient histories for handoffs or referrals), patient communication (generating after-visit summaries and discharge instructions), and clinical decision support (generating differential diagnoses, flagging relevant guidelines). Epic integrates LLM features directly into the EHR. The common thread is reducing the cognitive and administrative burden on clinicians while maintaining accuracy through human review. All clinical LLM outputs require physician review and approval before becoming part of the medical record.

Which companies have deployed Large Language Models & Generative AI? (48)

I
Inova Health
Inova Health deploys Notable AI Agents to automate revenue cycle and referral management across 4M+ annual patient visits
Hospital & Health SystemMedical Coding & Revenue CycleLarge Language Models & Generative AI
P
Pfizer
Pfizer deploys AI across R&D and commercial operations to cut billions in costs and boost productivity
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
P
Pharmaceutical companies (unnamed, via Accenture)
Pharmaceutical companies cut CTD authoring time 60–65% with Accenture's AWS generative AI solution
Pharmaceutical & Life ScienceClinical Trials & ResearchLarge Language Models & Generative AI
U
Undisclosed Top-10 Global Pharma
Top-10 Global Pharma Reduces Regulatory Submission Drafting Time by 75%+ with IBM Multi-Agent AI
Pharmaceutical & Life ScienceClinical Trials & ResearchLarge Language Models & Generative AI
U
Unnamed Global Pharmaceutical Company
Agentic AI cuts clinical trial protocol development from 6 months at global pharma company
Pharmaceutical & Life ScienceClinical Trials & ResearchLarge Language Models & Generative AI
M
Mass General Brigham / Brigham and Women's Hospital
Mass General Brigham cuts chest X-ray reading time 42% with generative AI preliminary reports
Imaging & RadiologyMedical Imaging & RadiologyLarge Language Models & Generative AI
U
UCLA Health
UCLA Health nursing AI program reduces clinician burnout and streamlines documentation across inpatient and ambulatory care
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI
C
Cleveland Clinic
Cleveland Clinic deploys AKASA AI coding tool enterprise-wide in four months, processing tens of thousands of encounters
Hospital & Health SystemMedical Coding & Revenue CycleLarge Language Models & Generative AI
C
Cleveland Clinic
Cleveland Clinic automates mid-revenue cycle coding with AKASA AI, achieving 80-90% automation rate
Hospital & Health SystemMedical Coding & Revenue CycleLarge Language Models & Generative AI
D
Dartmouth University Geisel School of Medicine
Dartmouth's Therabot gen AI chatbot reduces depression symptoms by 51% in first randomized controlled trial
Mental & Behavioral HealthMental Health & Digital TherapeuticsLarge Language Models & Generative AI
A
Atrium Health
Atrium Health DAX Copilot Study Finds 7% Documentation Time Reduction Only for High-Utilization Clinicians
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI
P
Piedmont Healthcare
Piedmont Healthcare reaches 93rd percentile Net EHR Experience Score through AI-powered in-basket management and clinical workflow optimization
Hospital & Health SystemPatient Flow & Hospital OperationsLarge Language Models & Generative AI
P
Pfizer
Pfizer cuts COVID-19 vaccine development from 8-10 years to 269 days using AWS AI and cloud infrastructure
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
D
Dartmouth College
Therabot generative AI chatbot reduces depression and anxiety symptoms in randomized controlled trial
Mental & Behavioral HealthMental Health & Digital TherapeuticsLarge Language Models & Generative AI
I
Insilico Medicine
Insilico Medicine's AI-generated drug INS018_055 enters Phase II human clinical trials for idiopathic pulmonary fibrosis
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
R
Radiology Associates of North Texas (RANT)
Radiology Associates of North Texas achieves 48% radiograph efficiency gain with Rad AI Reporting
Imaging & RadiologyClinical Documentation & Patient RecordsLarge Language Models & Generative AI
Favicon of Abridge
Duke Health
Duke Health deploys Abridge ambient AI documentation to 5,000 clinicians across 150+ clinics
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI
M
Merck & Co.
Merck deploys GPTeal enterprise AI platform reaching 50,000+ employees across pharma R&D
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
B
Bristol Myers Squibb
Bristol Myers Squibb accelerates clinical trial timelines by months with Workbench generative AI platform
Pharmaceutical & Life ScienceClinical Trials & ResearchLarge Language Models & Generative AI
Favicon of Abridge
Corewell Health
Corewell Health achieves 48% reduction in after-hours documentation and 53% burnout reduction with Abridge AI
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI
W
WellSpan Health
WellSpan Health achieves 97% patient satisfaction improvement with Nuance DAX Copilot ambient clinical documentation
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI
Favicon of Insilico Medicine
Insilico Medicine
Insilico Medicine discovers IPF drug candidate ISM001-055 in 18 months for $2M using generative AI
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
T
The Ohio State University College of Dentistry
Ohio State University College of Dentistry deploys Amazon Q Business POCAA to give students instant chairside access to 9,000+ curriculum artifacts
Dental & Oral HealthClinical Decision SupportLarge Language Models & Generative AI
C
Cleveland Clinic
Cleveland Clinic boosts ICD-10 capture and case mix index with GenAI-powered inpatient coding
Hospital & Health SystemMedical Coding & Revenue CycleLarge Language Models & Generative AI
I
Insilico Medicine
Insilico Medicine's Generative AI Platform Designs TNIK Inhibitor That Achieves Positive Phase 2a Results for IPF in 18-Month Discovery Timeline
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
D
Dartmouth Health
Dartmouth's Therabot AI therapy chatbot achieves 51% depression symptom reduction in first-ever generative AI clinical trial
Mental & Behavioral HealthMental Health & Digital TherapeuticsLarge Language Models & Generative AI
I
Insilico Medicine
Insilico Medicine reaches Phase 2a clinical milestone with generative AI-designed TNIK inhibitor for IPF in under 30 months
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
J
Johns Hopkins Medicine
Johns Hopkins Medicine reduces clinician documentation burden with ambient AI scribing across outpatient clinics
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI
A
AstraZeneca
AstraZeneca cuts protocol authoring time 85% with Modella AI multimodal models in oncology R&D
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
Favicon of Qventus
OhioHealth
OhioHealth saves $1.7M in months with Qventus AI-powered discharge planning
Hospital & Health SystemPatient Flow & Hospital OperationsLarge Language Models & Generative AI
P
Pfizer
Pfizer saves 16,000 scientist hours annually and cuts infrastructure costs 55% with AWS generative AI for drug development
Pharmaceutical & Life ScienceDrug Discovery & DevelopmentLarge Language Models & Generative AI
M
Merck
Merck cuts clinical study report drafting from 3 weeks to 4 days with LLM-powered authoring platform
Pharmaceutical & Life ScienceClinical Trials & ResearchLarge Language Models & Generative AI
F
Fraser Health
Fraser Health cuts discharge documentation time by 56% with MEDITECH AI-powered Hospital Course Summary
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI
U
UC San Francisco
UCSF AI matches physicians at ED triage, correctly identifying urgent cases 89% of the time
Hospital & Health SystemPatient Flow & Hospital OperationsLarge Language Models & Generative AI
N
National Institutes of Health (NIH) / National Library of Medicine
NIH's TrialGPT cuts clinical trial patient screening time by 40% using large language models
Pharmaceutical & Life ScienceClinical Trials & ResearchLarge Language Models & Generative AI
N
Northwestern Medicine
Northwestern Medicine adds 11.3 patients per month with DAX Copilot ambient AI documentation
Hospital & Health SystemClinical Documentation & Patient RecordsLarge Language Models & Generative AI

Which vendors have proven Large Language Models & Generative AI deployments? (4)

Favicon of QventusQventus1Favicon of AbridgeAbridge4Favicon of Eleos HealthEleos Health1Favicon of Insilico MedicineInsilico Medicine1