Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

Philipp Fleck; Fernando Reyes Aviles; Christian Pirchheim; Clemens Arth; Dieter Schmalstieg

doi:10.1007/978-3-030-94893-1_20

Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

Philipp Fleck, Fernando Reyes Aviles, Christian Pirchheim, Clemens Arth, Dieter Schmalstieg

Institute of Visual Computing (7100)

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › peer-review

Abstract

In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker’s user-interface.

By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.

Original language	English
Title of host publication	Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers
Subtitle of host publication	15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers
Editors	Kadi Bouatouch, A. Augusto de Sousa, Manuela Chessa, Alexis Paljic, Andreas Kerren, Christophe Hurter, Giovanni Maria Farinella, Petia Radeva, Jose Braz
Place of Publication	Cham
Publisher	Springer
Pages	431-452
Number of pages	22
ISBN (Electronic)	978-3-030-94893-1
ISBN (Print)	978-3-030-94892-4
DOIs	https://doi.org/10.1007/978-3-030-94893-1_20
Publication status	Published - 1 Jan 2022
Event	15th International Conference on Computer Vision Theory and Applications: VISAPP 2020 - Grand Hotel Excelsior, Valetta, Malta Duration: 27 Feb 2020 → 29 Feb 2020 http://www.visapp.visigrapp.org/ https://www.insticc.org/node/technicalprogram/visigrapp/2020

Publication series

Name	Communications in Computer and Information Science
Volume	1474 CCIS
ISSN (Print)	1865-0929
ISSN (Electronic)	1865-0937

Conference

Conference	15th International Conference on Computer Vision Theory and Applications
Abbreviated title	VISIGRAPP 2020
Country/Territory	Malta
City	Valetta
Period	27/02/20 → 29/02/20
Internet address	http://www.visapp.visigrapp.org/ https://www.insticc.org/node/technicalprogram/visigrapp/2020

Keywords

Remote collaboration
Telepresence
Augmented reality

ASJC Scopus subject areas

General Mathematics
General Computer Science

Access to Document

10.1007/978-3-030-94893-1_20Licence: Other

Cite this

Fleck, P., Reyes Aviles, F., Pirchheim, C., Arth, C., & Schmalstieg, D. (2022). Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. In K. Bouatouch, A. A. de Sousa, M. Chessa, A. Paljic, A. Kerren, C. Hurter, G. M. Farinella, P. Radeva, & J. Braz (Eds.), Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers (pp. 431-452). (Communications in Computer and Information Science; Vol. 1474 CCIS). Springer. https://doi.org/10.1007/978-3-030-94893-1_20

Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. / Fleck, Philipp; Reyes Aviles, Fernando; Pirchheim, Christian et al.
Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. ed. / Kadi Bouatouch; A. Augusto de Sousa; Manuela Chessa; Alexis Paljic; Andreas Kerren; Christophe Hurter; Giovanni Maria Farinella; Petia Radeva; Jose Braz. Cham: Springer, 2022. p. 431-452 (Communications in Computer and Information Science; Vol. 1474 CCIS).

Research output: Chapter in Book/Report/Conference proceeding › Conference paper › peer-review

Fleck, P, Reyes Aviles, F, Pirchheim, C, Arth, C & Schmalstieg, D 2022, Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. in K Bouatouch, AA de Sousa, M Chessa, A Paljic, A Kerren, C Hurter, GM Farinella, P Radeva & J Braz (eds), Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. Communications in Computer and Information Science, vol. 1474 CCIS, Springer, Cham, pp. 431-452, 15th International Conference on Computer Vision Theory and Applications, Valetta, Malta, 27/02/20. https://doi.org/10.1007/978-3-030-94893-1_20

Fleck P, Reyes Aviles F, Pirchheim C, Arth C , Schmalstieg D. Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. In Bouatouch K, de Sousa AA, Chessa M, Paljic A, Kerren A, Hurter C, Farinella GM, Radeva P, Braz J, editors, Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. Cham: Springer. 2022. p. 431-452. (Communications in Computer and Information Science). doi: 10.1007/978-3-030-94893-1_20

Fleck, Philipp ; Reyes Aviles, Fernando ; Pirchheim, Christian et al. / Exploring Tele-Assistance for Cyber-Physical Systems with MAUI. Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers: 15th International Joint Conference, VISIGRAPP 2020 Valletta, Malta, February 27–29, 2020, Revised Selected Papers. editor / Kadi Bouatouch ; A. Augusto de Sousa ; Manuela Chessa ; Alexis Paljic ; Andreas Kerren ; Christophe Hurter ; Giovanni Maria Farinella ; Petia Radeva ; Jose Braz. Cham : Springer, 2022. pp. 431-452 (Communications in Computer and Information Science).

@inproceedings{53cb75a339b644ca86e1309aaa5cf140,

title = "Exploring Tele-Assistance for Cyber-Physical Systems with MAUI",

abstract = "In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker{\textquoteright}s user-interface.By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.",

keywords = "Remote collaboration, Telepresence, Augmented reality",

author = "Philipp Fleck and {Reyes Aviles}, Fernando and Christian Pirchheim and Clemens Arth and Dieter Schmalstieg",

year = "2022",

month = jan,

day = "1",

doi = "10.1007/978-3-030-94893-1_20",

language = "English",

isbn = "978-3-030-94892-4",

series = "Communications in Computer and Information Science",

publisher = "Springer",

pages = "431--452",

editor = "Kadi Bouatouch and {de Sousa}, {A. Augusto} and Manuela Chessa and Alexis Paljic and Andreas Kerren and Christophe Hurter and Farinella, {Giovanni Maria} and Petia Radeva and Jose Braz",

booktitle = "Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers",

note = "15th International Conference on Computer Vision Theory and Applications : VISAPP 2020, VISIGRAPP 2020 ; Conference date: 27-02-2020 Through 29-02-2020",

url = "http://www.visapp.visigrapp.org/, https://www.insticc.org/node/technicalprogram/visigrapp/2020",

}

TY - GEN

T1 - Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

AU - Fleck, Philipp

AU - Reyes Aviles, Fernando

AU - Pirchheim, Christian

AU - Arth, Clemens

AU - Schmalstieg, Dieter

PY - 2022/1/1

Y1 - 2022/1/1

N2 - In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker’s user-interface.By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.

AB - In this paper we present an improved version of MAUI [9] (MAUI - Maintenance Assistance User Interface), extending the user-study, giving detailed insight into the implementations and introducing a new User-Interface for mobile use. MAUI is a novel take on tele-assisted tasks on cyber-physical systems. In its core we do not only provide real-time communication between workers and experts, but also allow an expert to have full control over the worker’s user-interface.By precisely separating levels of our software-stack, we enable features like hot-patching and hot-loading of any content or web-based application. Our results show reduced error-rate on task performance once an expert takes over virtual task to relieve the worker. Conditions evaluated include the worker operating on his own and the worker being actively supported. While in operation gauges have to be read, switches to be press and virtual user-interfaces of machinery have to be controlled. Furthermore, we explore the creation of user-interfaces through a developer-study and use the feedback to create a mobile version of MAUI.

KW - Remote collaboration

KW - Telepresence

KW - Augmented reality

UR - http://www.scopus.com/inward/record.url?scp=85124658767&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-94893-1_20

DO - 10.1007/978-3-030-94893-1_20

M3 - Conference paper

SN - 978-3-030-94892-4

T3 - Communications in Computer and Information Science

SP - 431

EP - 452

BT - Computer Vision, Imaging and Computer Graphics Theory and Applications - 15th International Joint Conference, VISIGRAPP 2020, Revised Selected Papers

A2 - Bouatouch, Kadi

A2 - de Sousa, A. Augusto

A2 - Chessa, Manuela

A2 - Paljic, Alexis

A2 - Kerren, Andreas

A2 - Hurter, Christophe

A2 - Farinella, Giovanni Maria

A2 - Radeva, Petia

A2 - Braz, Jose

PB - Springer

CY - Cham

T2 - 15th International Conference on Computer Vision Theory and Applications

Y2 - 27 February 2020 through 29 February 2020

ER -

Exploring Tele-Assistance for Cyber-Physical Systems with MAUI

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

MAUI: Tele-assistance for Maintenance of Cyber-physical Systems

Cite this