Real‐time markerless lung tumor tracking in fluoroscopic video: Handling overlapping of projected structures

Purpose:Fluoroscopic imaging is a well‐suited technique for online visualization of tumor motion in the thoracic region. Template‐based approaches for tumor tracking in such images are commonly used. However, overlapping of different structures, mainly bones, can lead to limited visibility of the projected tumor shape, which in turn can negatively affect the performance of the tracking method. In this study, a method based on multiple‐template matching was developed, providing fast and robust detection of tumor motion even under the influence of occurring tumor overlaps.Methods:A cohort of 14 patients with varying tumor sizes and locations was investigated. Image data from eight of these patients were used for evaluation. Based on the requirement of tumor visibility, the remaining datasets did not qualify for tracking. Generation of multiple templates was improved by implementation of an algorithm for automated selection of reference images containing the most characteristic tumor appearances. Various measures were taken to ensure real‐time capability of the algorithm. A prematching step was introduced in order to reduce dispensable comparison operations by selecting the most appropriate template. Subsequent matching was further optimized by using prior knowledge about likely tumor motion to effectively limit necessary matching tasks.Results:Tracking accuracy of the developed multiple‐template method was compared with that of single‐template. Mean errors of the multiple‐template approach were 0.6 ± 0.6 mm in left–right and 0.9 ± 0.9 mm in superior–inferior direction in the isocenter plane. The single‐template approach achieved mean errors of 0.7 ± 0.7 mm in left–right and 1.5 ± 1.3 mm in superior–inferior direction. These results derive from evaluation against manual tumor tracking performed by four expert observers. Computational times needed for tumor detection in a single fluoroscopic frame ranged between 1 and 29 ms depending on the tumor size and motion amplitude.Conclusions:This study shows that in case of tumor overlapping with dense structures, multiple‐template tracking provides more accurate results than a single‐template approach. The developed algorithm shows promising results in terms of suitability for real‐time application and robustness against frequently changing overlapping.