XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Jan Hendrik Plümer; Kevin Yu; Ulrich Eck; Denis Kalkofen; Philipp Steininger; Nassir Navab; Markus Tatzgern

doi:10.1109/ISMAR62088.2024.00014

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Jan Hendrik Plümer, Kevin Yu, Ulrich Eck, Denis Kalkofen, Philipp Steininger, Nassir Navab, Markus Tatzgern

Institute of Visual Computing (7100)

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › peer-review

Abstract

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

Original language	English
Title of host publication	Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024
Editors	Ulrich Eck, Misha Sra, Jeanine Stefanucci, Maki Sugimoto, Markus Tatzgern, Ian Williams
Pages	1-10
Number of pages	10
ISBN (Electronic)	9798331516475
DOIs	https://doi.org/10.1109/ISMAR62088.2024.00014
Publication status	Published - 2024
Event	23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024 - Hilton Bellevue in the Greater Seattle Area, Seattle, United States Duration: 21 Oct 2024 → 25 Oct 2024

Conference

Conference	23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024
Country/Territory	United States
City	Seattle
Period	21/10/24 → 25/10/24

Keywords

Extended reality
human-robot interaction
latency visualization
mixed reality
product development
prototyping

ASJC Scopus subject areas

Computer Science Applications
Media Technology
Modelling and Simulation

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1109/ISMAR62088.2024.00014Licence: CC BY 4.0

Cite this

Plümer, J. H., Yu, K., Eck, U., Kalkofen, D., Steininger, P., Navab, N., & Tatzgern, M. (2024). XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. In U. Eck, M. Sra, J. Stefanucci, M. Sugimoto, M. Tatzgern, & I. Williams (Eds.), Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024 (pp. 1-10) https://doi.org/10.1109/ISMAR62088.2024.00014

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. / Plümer, Jan Hendrik; Yu, Kevin; Eck, Ulrich et al.
Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. ed. / Ulrich Eck; Misha Sra; Jeanine Stefanucci; Maki Sugimoto; Markus Tatzgern; Ian Williams. 2024. p. 1-10.

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › peer-review

Plümer, JH, Yu, K, Eck, U, Kalkofen, D, Steininger, P, Navab, N & Tatzgern, M 2024, XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. in U Eck, M Sra, J Stefanucci, M Sugimoto, M Tatzgern & I Williams (eds), Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. pp. 1-10, 23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024, Seattle, Washington, United States, 21/10/24. https://doi.org/10.1109/ISMAR62088.2024.00014

Plümer JH, Yu K, Eck U, Kalkofen D, Steininger P, Navab N et al. XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. In Eck U, Sra M, Stefanucci J, Sugimoto M, Tatzgern M, Williams I, editors, Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. 2024. p. 1-10 doi: 10.1109/ISMAR62088.2024.00014

Plümer, Jan Hendrik ; Yu, Kevin ; Eck, Ulrich et al. / XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. editor / Ulrich Eck ; Misha Sra ; Jeanine Stefanucci ; Maki Sugimoto ; Markus Tatzgern ; Ian Williams. 2024. pp. 1-10

@inproceedings{c30d0861110147a9820d5f9c78321b57,

title = "XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot",

abstract = "Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.",

keywords = "Extended reality, human-robot interaction, latency visualization, mixed reality, product development, prototyping",

author = "Pl{\"u}mer, {Jan Hendrik} and Kevin Yu and Ulrich Eck and Denis Kalkofen and Philipp Steininger and Nassir Navab and Markus Tatzgern",

year = "2024",

doi = "10.1109/ISMAR62088.2024.00014",

language = "English",

pages = "1--10",

editor = "Ulrich Eck and Misha Sra and Jeanine Stefanucci and Maki Sugimoto and Markus Tatzgern and Ian Williams",

booktitle = "Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024",

note = "23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024 ; Conference date: 21-10-2024 Through 25-10-2024",

}

TY - GEN

T1 - XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

AU - Plümer, Jan Hendrik

AU - Yu, Kevin

AU - Eck, Ulrich

AU - Kalkofen, Denis

AU - Steininger, Philipp

AU - Navab, Nassir

AU - Tatzgern, Markus

PY - 2024

Y1 - 2024

N2 - Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

AB - Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

KW - Extended reality

KW - human-robot interaction

KW - latency visualization

KW - mixed reality

KW - product development

KW - prototyping

UR - http://www.scopus.com/inward/record.url?scp=85213517190&partnerID=8YFLogxK

U2 - 10.1109/ISMAR62088.2024.00014

DO - 10.1109/ISMAR62088.2024.00014

M3 - Conference paper

SP - 1

EP - 10

BT - Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024

A2 - Eck, Ulrich

A2 - Sra, Misha

A2 - Stefanucci, Jeanine

A2 - Sugimoto, Maki

A2 - Tatzgern, Markus

A2 - Williams, Ian

T2 - 23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024

Y2 - 21 October 2024 through 25 October 2024

ER -

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Abstract

Conference

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this