Project SENSE: Multimodal Simulation with Full-Body Real-Time Verbal & Nonverbal Interactions

Hossein Miri, J. Kolkmeier*, R. Poppe, P.J. Taylor, D. Heylen

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


This paper presents a multimodal simulation system, project-SENSE, that combines virtual reality and full-body motion capture technologies with real-time verbal and nonverbal communication. We introduce the technical setup and employed hardware and software of a first prototype. We discuss the capabilities of the system for the investigation of cooperation paradoxes and the effects of direct nonverbal mimicry. We argue that this prototype lays the technological basis for further research in interpersonal and social skills, as well as the social and emotional consequences of nonverbal mimicry in sustained interactions.
Original languageEnglish
Title of host publicationIntelligent Technologies for Interactive Entertainments
Subtitle of host publicationINTETAIN 2016
ISBN (Electronic)978-3-319-49616-0
ISBN (Print)978-3-319-49615-3
Publication statusPublished - 2017
Externally publishedYes
EventINTETAIN 2016: 8th International Conference on Intelligent Technologies for Interactive Entertainment - Utrecht, Netherlands
Duration: 28 Jun 201630 Jun 2016

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering


ConferenceINTETAIN 2016

Cite this