Multimodal Interaction with W3C Standards (eBook)

Dr. Deborah Dahl has over 20 years of experience in speech and natural language technologies, including working on research, defense, and commercial systems. She is also active in speech and multimodal standards activities in the World Wide Web Consortium, serving as Chair of the Multimodal Interaction Working Group and Co-Chair of the Hypertext Coordination Group. She is an editor of the EMMA (Extensible MultiModal Annotation specification). Dr. Dahl received the prestigious "Speech Luminary" award from Speech Technology Magazine, in 2012 and 2014.

Part I Standards.- 1 Introduction to the Multimodal Architecture.- 2 The role and importance of speech standards.- 3 Extensible Multimodal Annotation for Intelligent Interactive Systems.- 4 Emotion Markup Language.- 5 Introduction to SCXML.- 6 Dialogue Acts.- 7 Six-Layered Model for Multi-Modal Interaction Systems.- 8 WebRTC handling media on the web.- Part II Implementations.- 9 Developing portable context-aware multimodal applications for connected devices using W3C multimodal architecture.- 10 SCXML on Resource Constrained Devices.- 11 A Standard Portal for Intelligent Services.- 12 Assembling the jigsaw How multiple W3C standards are synergistically combined in the HALEF multimodal dialog system.- Part III Applications.- 13 Applications in Ambient Assisted Living.- 14 Applications in Ambient Assisted Living.- Part IV Future Directions.- 15 Finding and integrating components into dynamic systems.- 16 Laborda Multimodal Interactivity in Foreign Language Testing.- 17 Multi-device applications using the multimodal architecture.- 18 Multimodal Interaction Description Language based on data modeling.- 19 Multimodal Fusion and Fission within the W3C MMI Architectural Pattern.