The University of Twente (UT) employs 3,300 staff and has 9,000 students. It is part of the 4TU federation together with the technical universities of Eindhoven, Delft and Wageningen. The CTIT (Centre for Telematics and Information Technology) of the University of Twente is one of the largest academic ICT research institutes in Europe with over 475 researchers. A clear focus of CTIT is the integration of technology-based research and its application in specific domains. The Human Media Interaction (HMI) group is a part of the Computer Science Department and consists of about 10 staff and 20 PhD students. The focus of the group is on intelligent multimodal human technology interaction. HMI has a proven track record of participating in several multidisciplinary EU research projects (e.g., AMI and its successor AMIDA, SEMAINE, SSPNET, MESH, MediaCampaign, FROG, ACCOMPANY, SPENCER, SQUIRREL and EASEL.
Coordinator:
- Vanessa Evers (from the HMI group): Coordinator of the DE-ENIGMA project
Team members:
- Dirk Heylen: Dialogue management and affective computing
- Daphne Karreman: Human-robot interaction
- Bob Schadenberg: Robot behaviours development
- Pauline Chevalier
- Jamy Li
- Vicky Charisi
- Daniel Davison: Dialogue management and robot behaviour generation
- Bridgette Connel: Day-to-day project manager
- Lynn Packwood: Former Day-to-day project manager
Objectives and tasks:
- DE-ENIGMA Perception
- To focus in robust, context-sensitive and real time machine analysis of facial, bodily and vocal cues in unconstrained recording conditions that are atypical and abruptly changing as caractheristic for children with autism.
- Environmentally robust, personalised facial features
- To focus in robust, context-sensitive and real time machine analysis of facial, bodily and vocal cues in unconstrained recording conditions that are atypical and abruptly changing as caractheristic for children with autism.
- DE-ENIGMA Database collection, annotation and release
- To collect and release of a publicly available benchmark multilingual dataset of annotated facial, bodily, vocal and verbal recordings of interactions between children with autism and their counterpartners (therapist, robot, parent).
- DE-ENIGMA data acquisition
- To collect and release of a publicly available benchmark multilingual dataset of annotated facial, bodily, vocal and verbal recordings of interactions between children with autism and their counterpartners (therapist, robot, parent).
- DE-ENIGMA Integration and Evaluation
- To specify the functional requirements, interactions and constraints of DE-ENIGMA: construct the integrated DE-ENIGMA platform and assess the impact DE-ENIGMA skill training compared to traditional therapies on autistic children’s socio-emotional skills.
- Specifications of functional requirements, interactions and constraints
- Construction and integration of the DE-ENIGMA platform
- Assess the impact of robot-assisted socio-emotional skill training compared to traditional therapies to develop autistic children’s socio-emotional skills across cultures
- Final evaluation of the integrated DE-ENIGMA system
- To specify the functional requirements, interactions and constraints of DE-ENIGMA: construct the integrated DE-ENIGMA platform and assess the impact DE-ENIGMA skill training compared to traditional therapies on autistic children’s socio-emotional skills.
- DE-ENIGMA Reasoning
- This objective addresses the problem of automatic reasoning about behavioural patterns of the child as observed in unconstrained recordings of facial, vocal/verbal and bodily expressions, and based on the features extracted in the objective “DE-ENIGMA Perception”.
- Multi-Modal Rapport recognition
- This objective addresses the problem of automatic reasoning about behavioural patterns of the child as observed in unconstrained recordings of facial, vocal/verbal and bodily expressions, and based on the features extracted in the objective “DE-ENIGMA Perception”.
- DE-ENIGMA Robot-Child Interaction
- To understand the context of use for the DE-ENIGMA system and the design and development of the DE-ENIGMA interactive game to engage autistic children in developing socio-emotional skills
- Understanding of the needs of children with autism in learning socio-emotional skills
- Design and realisation of interactive game for training socio-emotional skills
- Controlled studies into effective robots behaviours
- To understand the context of use for the DE-ENIGMA system and the design and development of the DE-ENIGMA interactive game to engage autistic children in developing socio-emotional skills
- DE-ENIGMA Dissemination, Communication and Exploitation
- To create public, scientific and industrial awareness of the project achievements. Dissemination and exploitation activities will be performed in strict relation with all the technical activities
- Dissemination strategy
- DE-ENIGMA project website
- R&D output publications and conference participation
- Management of interactions with other EU projects
- To create public, scientific and industrial awareness of the project achievements. Dissemination and exploitation activities will be performed in strict relation with all the technical activities
- DE-ENIGMA Management
- To implement all technical, financial and administrative aspects of the project plan to ensure that it is executed in fulfillment of the contract with the European Commission.
- Project leadership and coordination
- Administrative and financial management
- Quality assurance and risk management
- Preparation for review of progress
- To implement all technical, financial and administrative aspects of the project plan to ensure that it is executed in fulfillment of the contract with the European Commission.
7522 NB ENSCHEDE
The Netherlands