MULTIMODAL INTERFACE DESIGN: AN EMPERICAL INVESTIGATION ON EFFICIENCY
Author(s):
Mohammad M. Alsuraihi,
Dimitrios I. Rigas
Paper abstract: This paper introduces an empirical multi-group study for investigating the experienced use of visual and
multimodal interaction metaphors for designing interfaces. The study aimed at comparing the efficiency
of multimodal interaction using voice-instruction and speech along with limited use of the mouse and the
keyboard against the efficiency of using visual-only interaction metaphors for using interface-design
environments. Efficiency of these interaction metaphors was compared in regard to task accomplishment
time and frequency of error-occurrence. In order to carry out this comparative investigation, three
experimental interface design toolkits (TVOID, OFVOID, and MMID) were built from scratch. TVOID
and OFVOID interacted with the user visually only using typical and time-saving interaction metaphors.
The third environment MMID added another modality through vocal and aural interaction. Then, these
environments were tested independently by three groups of experienced users. Each group consisted of
40 users. The results showed that the use of vocal commands and speech with limited use of the mouse
for completing tasks was more efficient in terms of shortening task accomplishment time and reducing
the number of errors than the use of the typical and time-saving visual-only interaction metaphors:
graphical menus, toolbar, toolbox, properties-table, hot-keys, scrollable-tags, instant-menus, textual-help,
and textual messages.
