← 6 days ago · Tue, Nov 10

Large language models show potential in MRI protocoling

Large language models show potential in MRI protocoling Radiology Business

At a glance

  • radiologybusiness.com: Large language models show potential in MRI protocoling
  • arxiv.org: Large language models show systematic failures in incorporating evolving medical knowledge

The story

radiologybusiness.com: Large language models show potential in MRI protocoling Radiology Business

arxiv.org: arXiv:2610.30631v2 Announce Type: replace Abstract: Medical knowledge evolves, yet whether large language models (LLMs) faithfully incorporate revisions into clinical recommendations remains unclear. We introduce ChronoEvo, comprising 1,709 recommendation-level revisions across 12 forms of medical knowledge change and 275 guideline lineages, to distinguish recognition of revised guidance from its full incorporation. With updated guideline evidence explicitly provided, revision recognition exceeded full incorporation across 14 models, with a 20.1-percentage-point gap in the strongest model. For Qwen3-4B, 90.8% of responses recognized revisions, 80.2% were clinically correct, and 58.5% fully incorporated them, yielding a 32.3-percentage-point gap. Two clinicians' adjudicated assessment of 300 responses yielded a 40.3-percentage-point gap in this enriched validation sample; 61 of 144 responses with incomplete incorporation were clinically incorrect. Prompting Qwen3-4B to prioritize revised evidence reduced outdated-content retention and improved clinical correctness without significantly improving full incorporation. These findings identify faithful incorporation of revised guidance as a distinct challenge for clinical LLM reliability.

Get tomorrow's scan at 7am

The same ranked list, in your inbox. Nothing else, ever.

← Back to 6 days ago