Skip to Main content Skip to Navigation

A SOA model, semantic and multimodal, for the discovery and registration of assistance services

Abstract : Unimodal inputs and outputs in current systems have become very mature with touch applications or distributed services for geo-localization or speech, audio and image recognition. However, the integration and instantiation of all these modalities, lack of an intelligent management of the acquisition and restitution context, based on highly formalized notions reflecting common sense. This requires a more dynamic behavior of the system with a more appropriate approach to manage the user environment.However, the technology required to achieve such a goal is not yet available in a standardized manner, both in terms of the functional description of unimodal services and in terms of their semantic description. This is also the case for multimodal architectures, where the semantic management is produced by each project without a common agreement in the field to ensure inter-operability, and it is often limited to the processing of inputs and outputs or fusion / fission mechanisms. To fill this gap, we propose a semantic service-oriented generic architecture for multimodal systems. This proposal aims to improve the description and the discovery of modality components for assistance services: this is the architecture SOA2m. This architecture is fully focused on multimodality and it is enriched with semantic technologies because we believe that this approach will enhance the autonomous behavior of multimodal applications, provide a robust perception of the user-system exchanges, and help in the control of the semantic integration of the human-computer interaction.As a result, the challenge of discovery is addressed using the tools provided by the field of the semantic web services
Document type :
Complete list of metadata
Contributor : ABES STAR :  Contact
Submitted on : Friday, November 6, 2015 - 3:02:06 PM
Last modification on : Friday, July 31, 2020 - 10:44:08 AM
Long-term archiving on: : Friday, April 28, 2017 - 4:39:53 AM


Version validated by the jury (STAR)


  • HAL Id : tel-01225667, version 1



Bertha Helena Rodriguez. A SOA model, semantic and multimodal, for the discovery and registration of assistance services. Human-Computer Interaction [cs.HC]. Télécom ParisTech, 2013. English. ⟨NNT : 2013ENST0006⟩. ⟨tel-01225667⟩



Record views


Files downloads