Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

Philipp Fleck; Fernando Reyes Aviles; Christian Pirchheim; Clemens Arth; Dieter Schmalstieg

doi:10.1007/978-3-030-94893-1_20

Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

Philipp Fleck, Fernando Reyes Aviles, Christian Pirchheim, Clemens Arth, Dieter Schmalstieg

Institut für Maschinelles Sehen und Darstellen (7100)

Publikation: Beitrag in Buch/Bericht/Konferenzband › Beitrag in einem Konferenzband › Begutachtung

Abstract

In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker’s user-interface.

By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.

Originalsprache	englisch
Titel	Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers
Untertitel	15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers
Redakteure/-innen	Kadi Bouatouch, A. Augusto de Sousa, Manuela Chessa, Alexis Paljic, Andreas Kerren, Christophe Hurter, Giovanni Maria Farinella, Petia Radeva, Jose Braz
Erscheinungsort	Cham
Herausgeber (Verlag)	Springer
Seiten	431-452
Seitenumfang	22
ISBN (elektronisch)	978-3-030-94893-1
ISBN (Print)	978-3-030-94892-4
DOIs	https://doi.org/10.1007/978-3-030-94893-1_20
Publikationsstatus	Veröffentlicht - 1 Jan. 2022
Veranstaltung	15th International Conference on Computer Vision Theory and Applications: VISAPP 2020 - Grand Hotel Excelsior, Valetta, Malta Dauer: 27 Feb. 2020 → 29 Feb. 2020 http://www.visapp.visigrapp.org/ https://www.insticc.org/node/technicalprogram/visigrapp/2020

Publikationsreihe

Name	Communications in Computer and Information Science
Band	1474 CCIS
ISSN (Print)	1865-0929
ISSN (elektronisch)	1865-0937

Konferenz

Konferenz	15th International Conference on Computer Vision Theory and Applications
Kurztitel	VISIGRAPP 2020
Land/Gebiet	Malta
Ort	Valetta
Zeitraum	27/02/20 → 29/02/20
Internetadresse	http://www.visapp.visigrapp.org/ https://www.insticc.org/node/technicalprogram/visigrapp/2020

ASJC Scopus subject areas

Allgemeine Mathematik
Allgemeine Computerwissenschaft

Zugriff auf Dokument

10.1007/978-3-030-94893-1_20Lizenz: Andere

Andere Dateien und Links

Verknüpfung zur Publikation in Scopus

Dieses zitieren

Fleck, P., Reyes Aviles, F., Pirchheim, C., Arth, C., & Schmalstieg, D. (2022). Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. in K. Bouatouch, A. A. de Sousa, M. Chessa, A. Paljic, A. Kerren, C. Hurter, G. M. Farinella, P. Radeva, & J. Braz (Hrsg.), Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers (S. 431-452). (Communications in Computer and Information Science; Band 1474 CCIS). Springer. https://doi.org/10.1007/978-3-030-94893-1_20

Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. / Fleck, Philipp; Reyes Aviles, Fernando; Pirchheim, Christian et al.
Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. Hrsg. / Kadi Bouatouch; A. Augusto de Sousa; Manuela Chessa; Alexis Paljic; Andreas Kerren; Christophe Hurter; Giovanni Maria Farinella; Petia Radeva; Jose Braz. Cham: Springer, 2022. S. 431-452 (Communications in Computer and Information Science; Band 1474 CCIS).

Publikation: Beitrag in Buch/Bericht/Konferenzband › Beitrag in einem Konferenzband › Begutachtung

Fleck, P, Reyes Aviles, F, Pirchheim, C, Arth, C & Schmalstieg, D 2022, Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. in K Bouatouch, AA de Sousa, M Chessa, A Paljic, A Kerren, C Hurter, GM Farinella, P Radeva & J Braz (Hrsg.), Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. Communications in Computer and Information Science, Bd. 1474 CCIS, Springer, Cham, S. 431-452, 15th International Conference on Computer Vision Theory and Applications, Valetta, Malta, 27/02/20. https://doi.org/10.1007/978-3-030-94893-1_20

Fleck P, Reyes Aviles F, Pirchheim C, Arth C , Schmalstieg D. Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. in Bouatouch K, de Sousa AA, Chessa M, Paljic A, Kerren A, Hurter C, Farinella GM, Radeva P, Braz J, Hrsg., Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. Cham: Springer. 2022. S. 431-452. (Communications in Computer and Information Science). doi: 10.1007/978-3-030-94893-1_20

Fleck, Philipp ; Reyes Aviles, Fernando ; Pirchheim, Christian et al. / Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. Hrsg. / Kadi Bouatouch ; A. Augusto de Sousa ; Manuela Chessa ; Alexis Paljic ; Andreas Kerren ; Christophe Hurter ; Giovanni Maria Farinella ; Petia Radeva ; Jose Braz. Cham : Springer, 2022. S. 431-452 (Communications in Computer and Information Science).

@inproceedings{53cb75a339b644ca86e1309aaa5cf140,

title = "Exploring Tele-Assistance for Cyber-Physical Systems with MAUI",

abstract = "In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker{\textquoteright}s user-interface.By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.",

keywords = "Remote collaboration, Telepresence, Augmented reality",

author = "Philipp Fleck and {Reyes Aviles}, Fernando and Christian Pirchheim and Clemens Arth and Dieter Schmalstieg",

year = "2022",

month = jan,

day = "1",

doi = "10.1007/978-3-030-94893-1_20",

language = "English",

isbn = "978-3-030-94892-4",

series = "Communications in Computer and Information Science",

publisher = "Springer",

pages = "431--452",

editor = "Kadi Bouatouch and {de Sousa}, {A. Augusto} and Manuela Chessa and Alexis Paljic and Andreas Kerren and Christophe Hurter and Farinella, {Giovanni Maria} and Petia Radeva and Jose Braz",

booktitle = "Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers",

note = "15th International Conference on Computer Vision Theory and Applications : VISAPP 2020, VISIGRAPP 2020 ; Conference date: 27-02-2020 Through 29-02-2020",

url = "http://www.visapp.visigrapp.org/, https://www.insticc.org/node/technicalprogram/visigrapp/2020",

}

TY - GEN

T1 - Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

AU - Fleck, Philipp

AU - Reyes Aviles, Fernando

AU - Pirchheim, Christian

AU - Arth, Clemens

AU - Schmalstieg, Dieter

PY - 2022/1/1

Y1 - 2022/1/1

N2 - In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker’s user-interface.By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.

AB - In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker’s user-interface.By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.

KW - Remote collaboration

KW - Telepresence

KW - Augmented reality

UR - http://www.scopus.com/inward/record.url?scp=85124658767&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-94893-1_20

DO - 10.1007/978-3-030-94893-1_20

M3 - Conference paper

SN - 978-3-030-94892-4

T3 - Communications in Computer and Information Science

SP - 431

EP - 452

BT - Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers

A2 - Bouatouch, Kadi

A2 - de Sousa, A. Augusto

A2 - Chessa, Manuela

A2 - Paljic, Alexis

A2 - Kerren, Andreas

A2 - Hurter, Christophe

A2 - Farinella, Giovanni Maria

A2 - Radeva, Petia

A2 - Braz, Jose

PB - Springer

CY - Cham

T2 - 15th International Conference on Computer Vision Theory and Applications

Y2 - 27 February 2020 through 29 February 2020

ER -

Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

Abstract

Publikationsreihe

Konferenz

ASJC Scopus subject areas

Zugriff auf Dokument

Andere Dateien und Links

Fingerprint

Dieses zitieren