Model-Free Authoring by Demonstration of Assembly Instructions in Augmented Reality

Ana Maria Stanescu; Peter Mohr-Ziak; Dieter Schmalstieg; Denis Kalkofen

doi:10.1109/TVCG.2022.3203104

Model-Free Authoring by Demonstration of Assembly Instructions in Augmented Reality

Ana Maria Stanescu, Peter Mohr-Ziak, Dieter Schmalstieg, Denis Kalkofen

Institute of Computer Graphics and Vision (7100)

Research output: Contribution to journal › Article › peer-review

Abstract

Among the most compelling applications of Augmented Reality are spatially registered tutorials. The effort of creating such instructions remains one of the obstacles precluding a wider use. We propose a system that is capable of extracting 3D instructions in a completely model-free manner from demonstrations, based on volumetric changes. The instructions are visualised later in an interactive Augmented Reality guidance application, on a mobile head-mounted display. We enable a technology that can be used by anyone in an ad-hoc tabletop setup for assemblies with rigid components.

Original language	English
Pages (from-to)	3821-3831
Number of pages	11
Journal	IEEE Transactions on Visualization and Computer Graphics
Volume	28
Issue number	11
DOIs	https://doi.org/10.1109/TVCG.2022.3203104
Publication status	Published - 1 Nov 2022

Keywords

Augmented Reality
Assembly tutorial
authoring by demonstration
3D reconstruction
augmented reality
assembly instructions

ASJC Scopus subject areas

Software
Signal Processing
Computer Vision and Pattern Recognition
Computer Graphics and Computer-Aided Design

Access to Document

10.1109/TVCG.2022.3203104

Cite this

@article{ed18d5fc9ca141789b68b1128f25b64f,

title = "Model-Free Authoring by Demonstration of Assembly Instructions in Augmented Reality",

abstract = "Among the most compelling applications of Augmented Reality are spatially registered tutorials. The effort of creating such instructions remains one of the obstacles precluding a wider use. We propose a system that is capable of extracting 3D instructions in a completely model-free manner from demonstrations, based on volumetric changes. The instructions are visualised later in an interactive Augmented Reality guidance application, on a mobile head-mounted display. We enable a technology that can be used by anyone in an ad-hoc tabletop setup for assemblies with rigid components.",

keywords = "Augmented Reality, Assembly tutorial, authoring by demonstration, 3D reconstruction, augmented reality, assembly instructions",

author = "Stanescu, {Ana Maria} and Peter Mohr-Ziak and Dieter Schmalstieg and Denis Kalkofen",

year = "2022",

month = nov,

day = "1",

doi = "10.1109/TVCG.2022.3203104",

language = "English",

volume = "28",

pages = "3821--3831",

journal = "IEEE Transactions on Visualization and Computer Graphics",

issn = "1077-2626",

publisher = "IEEE Computer Society",

number = "11",

}

TY - JOUR

T1 - Model-Free Authoring by Demonstration of Assembly Instructions in Augmented Reality

AU - Stanescu, Ana Maria

AU - Mohr-Ziak, Peter

AU - Schmalstieg, Dieter

AU - Kalkofen, Denis

PY - 2022/11/1

Y1 - 2022/11/1

N2 - Among the most compelling applications of Augmented Reality are spatially registered tutorials. The effort of creating such instructions remains one of the obstacles precluding a wider use. We propose a system that is capable of extracting 3D instructions in a completely model-free manner from demonstrations, based on volumetric changes. The instructions are visualised later in an interactive Augmented Reality guidance application, on a mobile head-mounted display. We enable a technology that can be used by anyone in an ad-hoc tabletop setup for assemblies with rigid components.

AB - Among the most compelling applications of Augmented Reality are spatially registered tutorials. The effort of creating such instructions remains one of the obstacles precluding a wider use. We propose a system that is capable of extracting 3D instructions in a completely model-free manner from demonstrations, based on volumetric changes. The instructions are visualised later in an interactive Augmented Reality guidance application, on a mobile head-mounted display. We enable a technology that can be used by anyone in an ad-hoc tabletop setup for assemblies with rigid components.

KW - Augmented Reality

KW - Assembly tutorial

KW - authoring by demonstration

KW - 3D reconstruction

KW - augmented reality

KW - assembly instructions

UR - http://www.scopus.com/inward/record.url?scp=85137925420&partnerID=8YFLogxK

U2 - 10.1109/TVCG.2022.3203104

DO - 10.1109/TVCG.2022.3203104

M3 - Article

SN - 1077-2626

VL - 28

SP - 3821

EP - 3831

JO - IEEE Transactions on Visualization and Computer Graphics

JF - IEEE Transactions on Visualization and Computer Graphics

IS - 11

ER -

Model-Free Authoring by Demonstration of Assembly Instructions in Augmented Reality

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this