This paper describes the current results and future developments of a project on multimodal spatial reference in mediated environments. The database consists of video-recorded sessions, with 120 participants in three experimental designs, contrasting types of pointing (No Pointing, Natural Pointing, Mediated Pointing), types of co-presence (Mediated versus Natural) and type of task (Locative versus Descriptive). The project investigates which verbal and non-verbal resources participants prefer to use in the different conditions, and which integration strategies they adopt. The goal, relevant to people interested in communication with/through technologies, or in multimodal communication in general, is to clarify the pragmatic meaning of the different resources. So far, the analysis of the data has focused on the verbal resources; further analysis will focus on the pointing strategies, and their integration with verbal spatial reference.

Multimodal spatial reference in mediated environments: users' preferences and the pragmatics of pointing and talking

SPAGNOLLI, ANNA;GAMBERINI, LUCIANO
2006

Abstract

This paper describes the current results and future developments of a project on multimodal spatial reference in mediated environments. The database consists of video-recorded sessions, with 120 participants in three experimental designs, contrasting types of pointing (No Pointing, Natural Pointing, Mediated Pointing), types of co-presence (Mediated versus Natural) and type of task (Locative versus Descriptive). The project investigates which verbal and non-verbal resources participants prefer to use in the different conditions, and which integration strategies they adopt. The goal, relevant to people interested in communication with/through technologies, or in multimodal communication in general, is to clarify the pragmatic meaning of the different resources. So far, the analysis of the data has focused on the verbal resources; further analysis will focus on the pointing strategies, and their integration with verbal spatial reference.
CHI '06 extended abstracts on Human factors in computing systems (CHI EA '06).
1595932984
File in questo prodotto:
Non ci sono file associati a questo prodotto.
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/2518927
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? ND
social impact