Development, Evaluation, and Deployment of a Multi-Agent System for Thoracic Tumor Board
Research paper by Tim Ellis-Caleo and collaborators. arXiv record dated 2026-04-14. Research area: Artificial intelligence.
Resource information
- Authors
- Tim Ellis-Caleo, Timothy Keyes, Nerissa Ambers, Faraah Bekheet, Wen-wai Yim, Nikesh Kotecha, Nigam H. Shah, Joel Neal
- Research area
- Artificial intelligence
- Application domain
- Agent systems
- AI methods
- Large language models
- Research topics
- cs.AI
- arXiv record date
- 2026-04-14
- Publication
- arXiv
- Upstream last modified
- Apr 15, 2026
- Last record update
- Nov 4, 2026
Abstract
Tumor boards are multidisciplinary conferences dedicated to producing actionable patient care recommendations with live review of primary radiology and pathology data. Succinct patient case summaries are needed to drive efficient and accurate case discussions. We developed a manual AI-based workflow to generate patient summaries to display live at the Stanford Thoracic Tumor board. To improve on this manually intensive process, we developed several automated AI chart summarization methods and evaluated them against physician gold standard summaries and fact-based scoring rubrics. We report these comparative evaluations as well as our deployment of the final state automated AI chart summarization tool along with post-deployment monitoring. We also validate the use of an LLM as a judge evaluation strategy for fact-based scoring. This work is an example of integrating AI-based workflows into routine clinical practice.