Multimodal Interfaces of Human–Computer Interaction

Abstract

An analytical review of state-of-the-art and future intelligent interfaces of human–computer interaction is presented; stages of their evolution are considered from command text to graphic and then to intelligent uni- and multimodal interfaces, based on the transfer of acoustic, visual, textual, and neural information. The principles of organization and the main characteristics and types of multimodal user interfaces, which employ concurrently several tools for automatic processing (recognition and synthesis) of userinputted heterogeneous information, are detailed. The combination of computers with speech and multimodal interfaces, designed for user-friendly information input/output, creates universal information–communicative technologies, man coming to the fore in the interaction between man and computer. Russian and foreign developments in this field are analyzed briefly.