Augmented Reality in Robotic-Assisted Surgery

Long Qian

[Abstract]

Robotics has transformed the surgical operation of today. Generally, the surgical robot, for example, the da Vinci robot, improves the dexterity of instruments, causes less trauma to the patient, and improves the surgeon comfort. On the other hand, augmented reality (AR) is an emerging technology that attracts a lot of research interest in the healthcare domain. AR can blend virtual information with the reality, allowing the user to see “more” beyond the reality. For example, with AR, the preoperative tumor model can be visualized on the endoscopic video, to improve the situation awareness of the surgeon. In this presentation, I will briefly introduce the literature about AR-integrated robotic-assisted surgery, followed by my recent work in this field: ARssist and ARAMIS. Both systems aim to provide advanced visualization at the bedside via Head-Mounted Displays (HMD) in robotic laparoscopic surgery.

[Biography]

Mr. Qian is a PhD candidate at the Johns Hopkins University. He works in the Laboratory of Computational Sensing and Robotic (LCSR), supervised by Prof. Peter Kazanzides and Prof. Nassir Navab. Prior to joining LCSR, Mr. Qian received B.S. from the Department of Electronics Engineering at Tsinghua University. Augmented Reality for healthcare is the main research interest for Mr. Qian. He has published 20+ papers in top conferences and journals in this area, including IEEE T-VCG, IEEE T-MRB, MICCAI, IJCARS, and ICRA. He is an active member of the da Vinci Research Kit (dVRK), an open source community to make medical robotics research more accessible. Mr. Qian has been supported by the technology research grant and clinical research grant from Intuitive Surgical Inc.