Build vs Buy The Conundrum of Radiology AI

Radiology AI research and development of commercial products has undergone unprecedented growth, although implementation of AI tools in clinical practice remains limited. Radiologists face numerous challenges in evaluating AI systems and deciding which might be worthwhile in their practices. This includes which problems to prioritize and whether to build systems internally or to purchase applications from an external vendor. Let’s discuss the key considerations for radiologists evaluating AI implementation in their practices.

Prioritizing problems is the first step

The fundamental challenge a radiologist faces is prioritizing which problems to address with AI. Tools exist to triage cases by identifying critical findings, increase efficiency by performing time-consuming tasks or assisting with report creation, and improve detection by identifying potentially overlooked findings. Understanding clinical context and patient populations is essential. While an outpatient-only practice might benefit most from an AI solution to identify pulmonary nodules on screening CT chest studies, a children’s hospital could decide to prioritize an AI solution for bone age radiographs, and a comprehensive stroke center might prioritize an AI solution for detecting large vessel occlusion on CTA head examinations.

What factors influence the decision to build or buy?

Having established what is to be prioritized, the next question is whether to build a tool internally or purchase an existing solution. This consideration is particularly applicable to large radiology practices and academic medical centers, as smaller practices likely lack sufficient scale to justify developing and implementing in-house AI solutions. Key considerations include the availability of data and experts to develop AI solutions, the return on investment (ROI), and long-term goals.

Development of an AI tool requires sufficient labeled imaging data for algorithms to train, as well as machine learning experts to develop and evaluate performance. Building an AI tool can be done with internal teams of experts or via partnerships between radiology practices and outside vendors. Practices might find it faster and cheaper to deploy existing pre-approved or FDA-cleared tools rather than embarking on development of an in-house solution. In areas where tools do not yet exist, however, development and FDA approval of novel AI solutions could provide opportunities for new revenue streams.

How can we measure the ROI of AI?

To date, it has been difficult to estimate the ROI from deploying AI solutions. Conventional performance metrics have largely focused on diagnostic performance, including specificity and sensitivity. For an organization evaluating whether to build or buy an AI tool, key questions include how it might translate to better patient care or improve efficiency and profit. Certainly, the New Technology Add-on Payment (NTAP), which CMS established for large vessel occlusion AI tools, provides a valuable incentive for hospitals to adopt this technology; though it remains to be seen whether other AI tools will be similarly reimbursable.

What an organization values most will be the deciding factor

The decision of build or buy AI hinges on expected value, risk tolerance, and organizational mission. A private practice looking to maximize short-term revenue and minimize investment risk might decide to selectively purchase tools that increase efficiency or partner with an AI startup company. Academic medical centers might decide that the development of internal AI systems is an important aspect of training and research ecosystems, offering opportunities for grant-funded research to explore applications of AI — which might not immediately be reimbursable or profitable, but which could eventually improve patient care. Ultimately, all radiologists are best served by staying informed of developments in AI and leveraging local knowledge and expertise to determine what solutions will work best for our patients.

To learn more about this topic, watch the on-demand DSI webinar on Build vs. Buy: The Conundrum of Radiology AI.

Justin Glavis-Bloom, MD | Fellow in Abdominal Imaging and Artificial Intelligence | University of California, Irvine 

Daniel S. Chow, MD, MBA |Co-Director for the Center for Artificial Intelligence in Diagnostic Medicine, University of California, Irvine | Assistant Professor-in-Residence, Department of Radiological Sciences and Neurology