Javascript must be enabled to continue!
Abstract 4371243: Analysis of Discrepancies Between Radiologist and AI CCTA Readings Across Clinical Thresholds
View through CrossRef
Background:
CCTA informs clinical decisions with stenosis thresholds that guide treatment, testing, and insurance approval. AI-based tools may reduce interpretative variability, but real-world consistency with radiologist assessments remains ambiguous. This study evaluates the magnitude and clinical impact of segment-level disagreement between radiologist- and AI-read CCTA.
Methods:
A single-center retrospective study of 48 patients who underwent CCTA with a radiologist and AI interpretation recorded percent stenosis across 16 coronary segments. Analysis excluded non-diseased segments identified by both reads. We calculated mean absolute difference (MAD) and threshold disagreement (TD), with thresholds defined at 50% and 70% stenosis. Data was labeled as an upward single- or double-crossing (USC; UDC), defined as stenosis differing by one threshold (eg. <50% vs. 50-69% or 50-69% vs. ≥70%) or both thresholds (eg. <50% vs. ≥70%), respectively. These terms describe the direction of difference, not accuracy.
Results:
Across 395 segments, the overall MAD between the radiologist and AI readings was 20.09% (SD = 6.06%). Ramus Intermedius had the highest MAD (30.0%) and segment-specific TD rate (42.86%). Distal LAD (29.5%) and PLB (28.9%) also showed high MADs
(Figure 1 and Table 1)
.
There were 75 TDs (18.99%), including 63 with a USC (50% = 54; 70% = 9) and 12 with a UDC. At 50%, radiologist USC occurred in 43 segments, and AI USC was in 11 segments. At 70%, radiologist USC occurred in 8 and AI USC in 1. Radiologists also produced more UDCs vs. AI (10 vs. 2). Chi-square testing showed significantly more frequent USCs by radiologists at the 50% threshold (chi-square = 20.37, p < 0.0001, OR = 3.91). Fisher’s exact test displayed near significance at the 70% threshold (p ~ 0.05, OR = 8.00) and significantly more UDCs by radiologists (p < 0.05, OR = 5.00) compared to AI
(Figure 2)
.
Conclusion:
Variation exists between radiologist- and AI-read CCTA, with nearly 1 in 5 segments having a TD. Posterior coronary segment readings, where anatomical limitations may challenge visualization, had the most inconsistencies. Discrepancies were most common in borderline and high-stakes ranges, where clinical decisions and insurance coverage hinge on stenosis classification. Findings support further validation of AI and caution against sole reliance. Comparative studies using heart catheterization are warranted to comment on accuracy versus variation.
Ovid Technologies (Wolters Kluwer Health)
Title: Abstract 4371243: Analysis of Discrepancies Between Radiologist and AI CCTA Readings Across Clinical Thresholds
Description:
Background:
CCTA informs clinical decisions with stenosis thresholds that guide treatment, testing, and insurance approval.
AI-based tools may reduce interpretative variability, but real-world consistency with radiologist assessments remains ambiguous.
This study evaluates the magnitude and clinical impact of segment-level disagreement between radiologist- and AI-read CCTA.
Methods:
A single-center retrospective study of 48 patients who underwent CCTA with a radiologist and AI interpretation recorded percent stenosis across 16 coronary segments.
Analysis excluded non-diseased segments identified by both reads.
We calculated mean absolute difference (MAD) and threshold disagreement (TD), with thresholds defined at 50% and 70% stenosis.
Data was labeled as an upward single- or double-crossing (USC; UDC), defined as stenosis differing by one threshold (eg.
<50% vs.
50-69% or 50-69% vs.
≥70%) or both thresholds (eg.
<50% vs.
≥70%), respectively.
These terms describe the direction of difference, not accuracy.
Results:
Across 395 segments, the overall MAD between the radiologist and AI readings was 20.
09% (SD = 6.
06%).
Ramus Intermedius had the highest MAD (30.
0%) and segment-specific TD rate (42.
86%).
Distal LAD (29.
5%) and PLB (28.
9%) also showed high MADs
(Figure 1 and Table 1)
.
There were 75 TDs (18.
99%), including 63 with a USC (50% = 54; 70% = 9) and 12 with a UDC.
At 50%, radiologist USC occurred in 43 segments, and AI USC was in 11 segments.
At 70%, radiologist USC occurred in 8 and AI USC in 1.
Radiologists also produced more UDCs vs.
AI (10 vs.
2).
Chi-square testing showed significantly more frequent USCs by radiologists at the 50% threshold (chi-square = 20.
37, p < 0.
0001, OR = 3.
91).
Fisher’s exact test displayed near significance at the 70% threshold (p ~ 0.
05, OR = 8.
00) and significantly more UDCs by radiologists (p < 0.
05, OR = 5.
00) compared to AI
(Figure 2)
.
Conclusion:
Variation exists between radiologist- and AI-read CCTA, with nearly 1 in 5 segments having a TD.
Posterior coronary segment readings, where anatomical limitations may challenge visualization, had the most inconsistencies.
Discrepancies were most common in borderline and high-stakes ranges, where clinical decisions and insurance coverage hinge on stenosis classification.
Findings support further validation of AI and caution against sole reliance.
Comparative studies using heart catheterization are warranted to comment on accuracy versus variation.
Related Results
Assessing the Appropriateness and Effectiveness of Coronary CT Angiography in COVID-19 Patients with Chest Pain
Assessing the Appropriateness and Effectiveness of Coronary CT Angiography in COVID-19 Patients with Chest Pain
Coronary CT Angiography (CCTA) is well established for Chest Pain (CP) evaluation to assess coronary artery stenosis. However, the appropriateness of CCTA for COVID-19 patients wit...
Coronary CT Angiography vs Functional Stress Testing in Chest Pain Evaluation; A Meta-Analysis of Diagnostic Accuracy, Revascularization Rates, and Cost-Effectiveness
Coronary CT Angiography vs Functional Stress Testing in Chest Pain Evaluation; A Meta-Analysis of Diagnostic Accuracy, Revascularization Rates, and Cost-Effectiveness
Background: Chest pain is a common clinical feature and medical diagnostic dilemma in both emergency and outpatient care. There are two major non-invasive methods for the managemen...
P6176Added value of computed tomography fractional flow reserve (FFRCT) in the diagnosis of coronary artery disease (CAD)
P6176Added value of computed tomography fractional flow reserve (FFRCT) in the diagnosis of coronary artery disease (CAD)
Abstract
Purpose
Multiple non-invasive tests are performed as part of the standard protocol to diagnose CAD, but all are limited...
P5637A novel bioresorbable magnesium-based stent: initial clinical results and 6-months follow-up by coronary computed tomography angiography scan
P5637A novel bioresorbable magnesium-based stent: initial clinical results and 6-months follow-up by coronary computed tomography angiography scan
Abstract
Background
Drug-eluting stents (DES) are the gold standard in percutaneous coronary interventions (PCI), but leave a pe...
Real world economic evaluation of CT-FFR in patients with suspected coronary artery disease
Real world economic evaluation of CT-FFR in patients with suspected coronary artery disease
Abstract
Background
Incorporation of CT-derived fractional flow reserve (CT-FFR) enhances the precision of Coronary CT Angiograp...
Accuracy and limitation of plaque detection by coronary CTA: a section-to-section comparison with optical coherence tomography
Accuracy and limitation of plaque detection by coronary CTA: a section-to-section comparison with optical coherence tomography
AbstractPlaques identified by Coronary CT angiography (CCTA) are important in clinical diagnosis and primary prevention. High-risk plaque features by CCTA have been extensively val...
Comparison of radiation dose and its correlates between coronary computed tomography angiography and invasive coronary angiography in Northeastern Thailand
Comparison of radiation dose and its correlates between coronary computed tomography angiography and invasive coronary angiography in Northeastern Thailand
Abstract
Background
The number of coronary computed tomography angiography (CCTA) exams is steadily growing. A novel computed tomography (CT) system...
A Comparative Study of 64-Slice Coronary CT Angiography (CCTA) and Myocardial Perfusion Imaging (MPI) in the Identification of Coronary Artery Stenosis
A Comparative Study of 64-Slice Coronary CT Angiography (CCTA) and Myocardial Perfusion Imaging (MPI) in the Identification of Coronary Artery Stenosis
Objective: The aim of this study was to compare the diagnostic accuracy of 64-Slice Coronary Computer Tomography Angiography (CCTA) and Myocardial Perfusion Imaging (MPI) in the id...

