Semi-automatic puncture robotic system based on real-time multi-modal image fusion: preclinical evaluation

Abstract Purpose Traditional surgical robot system relying on computed tomography (CT) navigation suffers from two drawbacks during abdominal organ puncture surgeries. Firstly, the puncture target is displaced under the influence of respiration, thereby reducing the puncture accuracy. Secondly, the puncture process lacks real-time visualization, which may potentially give rise to medical accidents. This paper presents a semi-automatic surgical robot system based on the fusion guidance of real-time ultrasound images and CT, along with the monitoring of the patient’s respiratory state, to address these issues. Method This system utilizes a six-axis force sensor in contact with the human body, and a respiratory model can be constructed through data got from force sensor to monitor the patient’s respiratory phase and recommend the optimal puncture phase. The issue of non-real-time puncture guidance is addressed through the real-time registration and fusion of ultrasound (US) images with preoperative CT images. Results Phantom experiments and animal experiments were carried out based on this design. The test results indicate that in these two experiments, the average fusion error between US and CT of the main tissues in the liver is within 3 mm. For puncture accuracy, in the phantom experiment, the average puncture error was 1.0 mm, with a minimum of 0 mm and a maximum of 2.1 mm. In the animal experiment, the average puncture error was 2.5 mm, ranging from a minimum of 1.6 mm to a maximum of 3.0 mm. Conclusion The results of two experiments show both the image fusion accuracy and puncture accuracy of this system are within 3mm, which can meet the requirement of 5 mm puncture accuracy in clinical practice. Approximately 70% of the operation are automatically accomplished by robot system, greatly reducing the reliance on the doctor’s experience.