TY - GEN
T1 - Mixed Reality Communication for Medical Procedures: Teaching the Placement of a Central Venous Catheter
AU - Rebol, Manuel
AU - Pietroszek, Krzysztof
AU - Ranniger, Claudia
AU - Hood, Colton
AU - Rutenberg, Adam
AU - Sikka, Neal
AU - Li, David
AU - Gütl, Christian
PY - 2022
Y1 - 2022
N2 - Medical procedures are an essential part of healthcare delivery, and the acquisition of procedural skills is a critical component of medical education. Unfortunately, procedural skill is not evenly distributed among medical providers. Skills may vary within departments or institutions, and across geographic regions, depending on the provider’s training and ongoing experience. We present a mixed reality real-time communication system to increase access to procedural skill training and to improve remote emergency assistance. Our system allows a remote expert to guide a local operator through a medical procedure. RGBD cameras capture a volumetric view of the local scene including the patient, the operator, and the medical equipment. The volumetric capture is augmented onto the remote expert’s view to allow the expert to spatially guide the local operator using visual and verbal instructions. We evaluated our mixed reality communication system in a study in which experts teach the ultrasound-guided placement of a central venous catheter (CVC) to students in a simulation setting. The study compares state-of-the-art video communication against our system. The results indicate that our system enhances and offers new possibilities for visual communication compared to video teleconference-based training.
AB - Medical procedures are an essential part of healthcare delivery, and the acquisition of procedural skills is a critical component of medical education. Unfortunately, procedural skill is not evenly distributed among medical providers. Skills may vary within departments or institutions, and across geographic regions, depending on the provider’s training and ongoing experience. We present a mixed reality real-time communication system to increase access to procedural skill training and to improve remote emergency assistance. Our system allows a remote expert to guide a local operator through a medical procedure. RGBD cameras capture a volumetric view of the local scene including the patient, the operator, and the medical equipment. The volumetric capture is augmented onto the remote expert’s view to allow the expert to spatially guide the local operator using visual and verbal instructions. We evaluated our mixed reality communication system in a study in which experts teach the ultrasound-guided placement of a central venous catheter (CVC) to students in a simulation setting. The study compares state-of-the-art video communication against our system. The results indicate that our system enhances and offers new possibilities for visual communication compared to video teleconference-based training.
KW - Computer graphics
KW - Computer vision
KW - Computer vision problems
KW - Computing methodologies
KW - Graphics systems and interfaces
KW - Medical
KW - Mixed/augmented reality
KW - Reconstruction Social and professional topics
UR - http://www.scopus.com/inward/record.url?scp=85146421311&partnerID=8YFLogxK
U2 - 10.1109/ISMAR55827.2022.00050
DO - 10.1109/ISMAR55827.2022.00050
M3 - Conference paper
T3 - Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
SP - 346
EP - 354
BT - Proceedings - 2022 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2022
A2 - Duh, Henry
A2 - Williams, Ian
A2 - Grubert, Jens
A2 - Jones, J. Adam
A2 - Zheng, Jianmin
T2 - 2022 IEEE International Symposium on Mixed and Augmented Reality
Y2 - 17 October 2022 through 21 October 2022
ER -