Representing communicative function and behavior in multimodal communication

Hannes Högni Vilhjálmsson

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Citations (Scopus)

Abstract

In this paper I discuss how communicative behavior can be represented at two levels of abstraction, namely the higher level of communicative intent or function, which does not make any claims about the surface form of the behavior, and the lower level of physical behavior description, which in essence instantiates intent as a particular multimodal realization. I briefly outline the proposed SAIBA framework for multimodal generation of communicative behavior, which is an international research platform that fosters the exchange of components between different systems. The SAIBA framework currently contains a first draft of the lower level Behavior Markup Language (BML) and is starting work on the higher level Function Markup Language (FML). I also briefly explain the usefulness of this distinction by using examples of several implemented systems that each draws different strengths from it. These systems range from autonomous conversational agents to computer mediated communication.

Original languageEnglish
Title of host publicationMultimodal Signals
Subtitle of host publicationCognitive and Algorithmic Issues - COST Action 2102 and euCognition International School, Revised Selected and Invited Papers
Pages47-59
Number of pages13
DOIs
Publication statusPublished - 2009
EventCOST Action 2102 and euCognition International School on Multimodal Signals: Cognitive and Algorithmic Issues - Vietri sul Mare, Italy
Duration: 21 Apr 200826 Apr 2008

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5398 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceCOST Action 2102 and euCognition International School on Multimodal Signals: Cognitive and Algorithmic Issues
Country/TerritoryItaly
CityVietri sul Mare
Period21/04/0826/04/08

Other keywords

  • Communicative behavior
  • Communicative function
  • Embodied conversational agents
  • Mediated communication
  • Multimodal communication

Fingerprint

Dive into the research topics of 'Representing communicative function and behavior in multimodal communication'. Together they form a unique fingerprint.

Cite this