This workshop addresses the role of multimodality and mediated interaction for the analysis and design of human-centred, embodied, cognitive user experiences. Of particular interest are embodied visual-spatial, visuo-auditory, and visuo-locomotive cognitive experiences.

The workshop is organised as part of the The 16th International Conference on Human-Computer Interaction (INTERACT '17, https://www.interact2017.org/) to be held in Mumbai, India during September 25 - 29, 2017.

Workshop chairs:
Mehul Bhatt
Human-Centred Cognitive Assistance Lab.
Department of Computer Science
, University of Bremen, Germany.

Clayton Lewis
University of Colorado Boulder
Department of Computer Science
, University of Colorado Boulder, United States.

Scope and Focus of the Workshop

The workshop brings together experts in:

  • Human-Computer Interaction
  • Spatial Cognition and Computation
  • Cognitive Science and Psychology
  • Artificial intelligence
  • Neuroscience
  • Communications and Media
  • Design Studies

Technical Focus. The workshop focusses on multimodality studies aimed at the semantic interpretation of human behaviour, and the empirically-driven synthesis of embodied interactive experiences in real world settings. In focus are narrative media design, architecture & built environment design, product design, cognitive media studies (film, animation, VR, sound & music), and user interaction studies. In these and other design contexts, the workshop emphasises evidence-based multimodality studies from the viewpoints of visual (e.g., attention and recipient effects), visuo-locomotive (e.g., movement, wayfinding), and visuo-auditory (e.g., narrative media) cognitive experiences. Modalities being investigated include, but are not limited to:

  • Visual attention (e.g., by eye-tracking), gesture, speech, language, facial expressions, tactile interactions, olfaction
  • Human expert guided event segmentation (e.g. coming from behavioural or environmental psychologists, designers, annotators, crowd-sensing)
  • Deep analysis based on dialogic components, think-aloud protocols

The scientific agenda of the workshop focusses on the multi-modality of the objects, artefacts, and interactive people-experiences emanating therefrom. Universality and inclusion in design are of overarching focus in all design contexts relevant to this workshop; here, the implications of multimodality studies for inclusive design, e.g., creation of presentations of the same content in different modalities, are also of interest.

Interact 2017

HCC Lab., University of Bremen

DesignSpace Group, University of Bremen

University of Bremen

University of Colorado

Submissions and Participation

The workshop provides a platform to discuss the development of next-generation embodied interaction design systems, practices, and (human-centered) assistive frameworks & technologies encompassing the multi-faceted nature of embodied interaction design conception, analysis, and synthesis. All contributions addressing the workshop themes from formal, computational, cognitive, design, engineering, empirical, and philosophical perspectives are most welcome.

Submission Types. Contributions may be submitted as: (1). technical papers; (2) position statements; (3) case-studies of design projects, experiments etc; (4) work in progress reports. If you have additional creative ideas, please contact the workshop organizers.

Submission Requirements. Authors are invited to submit short papers using the Springer LNCS Format (4 pages max) sent as PDF. All submitted short papers are subject to acceptance by the committee members. Proposals will be selected based on their originality and quality by the workshop organizers. All contributions should be mailed to: bhatt@uni-bremen.de (please use this as subject line: "INTERACT 2017 Workshop Submission")

All accepted submissions will be published as a technical report on the workshop’s webpage. Additional plans are currently in progress and will be finalised in due course.

Important Dates in 2017.

  • Submission: July 15
  • Notification: July 22
  • Camera Ready: July 28
  • Conference: September 25-26, 2017


All workshop participants will have to register to participate in the workshop at: Interact 2017 Registration.

  • For those who are registering for at least one of the days of the conference, the workshop registration fees is: ₹ 3,500 (~ 53 USD).
  • For those who are attending only the workshop, the registration fees is: ₹ 6,000 (~ 92 USD).

Workshop Steering and Organisation

Workshop Chairs:

  • Mehul Bhatt (University of Bremen, Germany)
    Professor within the Faculty of Mathematics and Informatics at the University of Bremen, Germany; and Stiftungs Professor at the German Research Center for Artificial Intelligence (DFKI Bremen). He leads the Human-Centred Cognitive Assistance Lab at the University of Bremen, Germany ( http://hcc.uni-bremen.de), and is co-founder of the research and consulting group DesignSpace ( http://www.design-space.org). Mehul’s research encompasses the areas of artificial intelligence, cognitive science, and human-computer interaction.
  • Clayton Lewis (University of Colorado Boulder, United States)
    Professor of Computer Science and Fellow of the Institute of Cognitive Science at the University of Colorado, Boulder (United States). He is well known for his research on evaluation methods in user interface design, and contributions in the thinking aloud method and cognitive walkthrough methods. He was elected to the ACM CHI Academy in 2009, recognizing his contributions to the field of human-computer interaction. In 2011 he was further recognized by the ACM CHI Social Impact Award, for his work on technology for people with cognitive, language, and learning disabilities.