XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Jan Hendrik Plümer; Kevin Yu; Ulrich Eck; Denis Kalkofen; Philipp Steininger; Nassir Navab; Markus Tatzgern

doi:10.1109/ISMAR62088.2024.00014

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Jan Hendrik Plümer, Kevin Yu, Ulrich Eck, Denis Kalkofen, Philipp Steininger, Nassir Navab, Markus Tatzgern

Institute of Visual Computing (7100)

Publikation: Beitrag in Buch/Bericht/Konferenzband › Beitrag in einem Konferenzband › Begutachtung

Abstract

Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

Originalsprache	englisch
Titel	Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024
Redakteure/-innen	Ulrich Eck, Misha Sra, Jeanine Stefanucci, Maki Sugimoto, Markus Tatzgern, Ian Williams
Seiten	1-10
Seitenumfang	10
ISBN (elektronisch)	9798331516475
DOIs	https://doi.org/10.1109/ISMAR62088.2024.00014
Publikationsstatus	Veröffentlicht - 2024
Veranstaltung	23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024 - Hilton Bellevue in the Greater Seattle Area, Seattle, USA / Vereinigte Staaten Dauer: 21 Okt. 2024 → 25 Okt. 2024

Konferenz

Konferenz	23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024
Land/Gebiet	USA / Vereinigte Staaten
Ort	Seattle
Zeitraum	21/10/24 → 25/10/24

ASJC Scopus subject areas

Angewandte Informatik
Medientechnik
Modellierung und Simulation

UN SDGs

Dieser Output leistet einen Beitrag zu folgendem(n) Ziel(en) für nachhaltige Entwicklung

Zugriff auf Dokument

10.1109/ISMAR62088.2024.00014Lizenz: CC BY 4.0

Andere Dateien und Links

Verknüpfung zur Publikation in Scopus

Dieses zitieren

Plümer, J. H., Yu, K., Eck, U., Kalkofen, D., Steininger, P., Navab, N., & Tatzgern, M. (2024). XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. in U. Eck, M. Sra, J. Stefanucci, M. Sugimoto, M. Tatzgern, & I. Williams (Hrsg.), Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024 (S. 1-10) https://doi.org/10.1109/ISMAR62088.2024.00014

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. / Plümer, Jan Hendrik; Yu, Kevin; Eck, Ulrich et al.
Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. Hrsg. / Ulrich Eck; Misha Sra; Jeanine Stefanucci; Maki Sugimoto; Markus Tatzgern; Ian Williams. 2024. S. 1-10.

Publikation: Beitrag in Buch/Bericht/Konferenzband › Beitrag in einem Konferenzband › Begutachtung

Plümer, JH, Yu, K, Eck, U, Kalkofen, D, Steininger, P, Navab, N & Tatzgern, M 2024, XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. in U Eck, M Sra, J Stefanucci, M Sugimoto, M Tatzgern & I Williams (Hrsg.), Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. S. 1-10, 23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024, Seattle, Washington, USA / Vereinigte Staaten, 21/10/24. https://doi.org/10.1109/ISMAR62088.2024.00014

Plümer JH, Yu K, Eck U, Kalkofen D, Steininger P, Navab N et al. XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. in Eck U, Sra M, Stefanucci J, Sugimoto M, Tatzgern M, Williams I, Hrsg., Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. 2024. S. 1-10 doi: 10.1109/ISMAR62088.2024.00014

Plümer, Jan Hendrik ; Yu, Kevin ; Eck, Ulrich et al. / XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot. Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024. Hrsg. / Ulrich Eck ; Misha Sra ; Jeanine Stefanucci ; Maki Sugimoto ; Markus Tatzgern ; Ian Williams. 2024. S. 1-10

@inproceedings{c30d0861110147a9820d5f9c78321b57,

title = "XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot",

abstract = "Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.",

keywords = "Extended reality, human-robot interaction, latency visualization, mixed reality, product development, prototyping",

author = "Pl{\"u}mer, {Jan Hendrik} and Kevin Yu and Ulrich Eck and Denis Kalkofen and Philipp Steininger and Nassir Navab and Markus Tatzgern",

year = "2024",

doi = "10.1109/ISMAR62088.2024.00014",

language = "English",

pages = "1--10",

editor = "Ulrich Eck and Misha Sra and Jeanine Stefanucci and Maki Sugimoto and Markus Tatzgern and Ian Williams",

booktitle = "Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024",

note = "23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024 ; Conference date: 21-10-2024 Through 25-10-2024",

}

TY - GEN

T1 - XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

AU - Plümer, Jan Hendrik

AU - Yu, Kevin

AU - Eck, Ulrich

AU - Kalkofen, Denis

AU - Steininger, Philipp

AU - Navab, Nassir

AU - Tatzgern, Markus

PY - 2024

Y1 - 2024

N2 - Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

AB - Researching novel user experiences in medicine is challenging due to limited access to equipment and strict ethical protocols. Extended Reality (XR) simulation technologies offer a cost-and time-efficient solution for developing interactive systems. Recent work has shown Extended Reality Prototyping (XRP)'s potential, but its applicability to specific domains like controlling complex machinery needs further exploration. This paper explores the benefits and limitations of XRP in controlling a mobile medical imaging robot. We compare two XR visualization techniques to reduce perceived latency between user input and robot activation. Our XRP validation study demonstrates its potential for comparative studies, but identifies a gap in modeling human behavior in the analytic XRP validation framework.

KW - Extended reality

KW - human-robot interaction

KW - latency visualization

KW - mixed reality

KW - product development

KW - prototyping

UR - http://www.scopus.com/inward/record.url?scp=85213517190&partnerID=8YFLogxK

U2 - 10.1109/ISMAR62088.2024.00014

DO - 10.1109/ISMAR62088.2024.00014

M3 - Conference paper

SP - 1

EP - 10

BT - Proceedings - 2024 IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2024

A2 - Eck, Ulrich

A2 - Sra, Misha

A2 - Stefanucci, Jeanine

A2 - Sugimoto, Maki

A2 - Tatzgern, Markus

A2 - Williams, Ian

T2 - 23rd IEEE International Symposium on Mixed and Augmented Reality: ISMAR 2024

Y2 - 21 October 2024 through 25 October 2024

ER -

XR Prototyping of Mixed Reality Visualizations: Compensating Interaction Latency for a Medical Imaging Robot

Abstract

Konferenz

ASJC Scopus subject areas

UN SDGs

Zugriff auf Dokument

Andere Dateien und Links

Fingerprint

Dieses zitieren