The Simion Stoilow Institute of Mathematics (IMAR) is one of the flagship research institutes of the Romanian Academy, founded in 1949 and represents one of the most significant centres of the Romanian mathematics and informatics life. It has over 120 permanent researcher positions, under ranks as CS1 (research director or professor legal equivalent), CS2 (associate professor equivalent), CS3 (lecturer equivalent), as well as researcher, assistant researcher, and contract researchers, working in major areas of mathematics and computer science. The activity at IMAR focuses on advanced scientific research in mathematics, computer science, and applications. Among IMAR’s permanent staff one can find researchers with doctorates at academic research institutions like Harvard, Pierre and Marie Curie, Oxford, MIT, INRIA, Edinburgh, Michigan Ann Arbour, SUNNY, John Hopkins or Leuven.
The Computational Learning and Visual Perception Group (CLVP) at IMAR covers an entire floor of over 300m2 of rennovated space with its own operated state of the art human motion capture, human eye tracking and cluster computing equipment. The laboratory hosts 10 researchers focusing on computer vision and machine learning. Areas of particular interest include human motion analysis, the semantic segmentation of images and large scale structured prediction models. Over the past 6 years the group has also been involved in the construction of three large-scale datasets made available online together with features, novel large-scale estimation models, processing software (visualization, evaluation): (1) 3d human pose estimation (Human3.6M contains 3.6 million poses – 2 orders of magnitude larger than existing repositories, (2) human gaze in the context of action recognition in video (650,000 fixations); (3) human gaze, action recognition in static images (over 1 million fixations from 9157 images). (2), (3) are the largest eye movement datasets ever created, novel also in the use of task controls (vs. free-viewing). The laboratory has been funded by competitive national and international agencies, where over the past 6 years has secured over 5 million euro. It has ongoing collaborations with reserarchers at the University of Bonn, University of Toronto, Lund University, University of California at Berkeley, Georgia Institute of Technology, and Google Research.
Team leader:
- Cristian Sminchisescu (from the CLVP group): Mathematical modeling for computer vision and machine learning
Team members:
- Vlad Olaru: 3D intelligent sensors, real-time systems and high-performance computing for computer vision programs with emphasis on human pose estimation
- Elisabeta Marinoiui: Gesture recognition, stance detection and augmented reality
- Alin Popa: Computer vision and machine learning
- Mihai Zanfir: Action recognition and human pose estimation
Objectives and tasks:
- DE-ENIGMA Perception
- To focus in robust, context-sensitive and real time machine analysis of facial, bodily and vocal cues in unconstrained recording conditions that are atypical and abruptly changing as caractheristic for children with autism.
- Environmentally robust, personalised bodily features
- To focus in robust, context-sensitive and real time machine analysis of facial, bodily and vocal cues in unconstrained recording conditions that are atypical and abruptly changing as caractheristic for children with autism.
- DE-ENIGMA Database collection, annotation and release
- To collect and release of a publicly available benchmark multilingual dataset of annotated facial, bodily, vocal and verbal recordings of interactions between children with autism and their counterpartners (therapist, robot, parent).
- Ethical Approval
- DE-ENIGMA data acquisition
- DE-ENIGMA data annotation
- DE-ENIGMA database design, release and maintenance
- To collect and release of a publicly available benchmark multilingual dataset of annotated facial, bodily, vocal and verbal recordings of interactions between children with autism and their counterpartners (therapist, robot, parent).
- DE-ENIGMA Reasoning
- This objective addresses the problem of automatic reasoning about behavioural patterns of the child as observed in unconstrained recordings of facial, vocal/verbal and bodily expressions, and based on the features extracted in the objective “DE-ENIGMA Perception”.
- Multi-modal estimation of affect, interest and stress levels
- Context transfer
- This objective addresses the problem of automatic reasoning about behavioural patterns of the child as observed in unconstrained recordings of facial, vocal/verbal and bodily expressions, and based on the features extracted in the objective “DE-ENIGMA Perception”.
- DE-ENIGMA Integration and Evaluation
- To specify the functional requirements, interactions and constraints of DE-ENIGMA: construct the integrated DE-ENIGMA platform and assess the impact DE-ENIGMA skill training compared to traditional therapies on autistic children’s socio-emotional skills.
- Specifications of functional requirements, interactions and constraints
- Construction and integration of the DE-ENIGMA platform
- Final evaluation of the integrated DE-ENIGMA system
- To specify the functional requirements, interactions and constraints of DE-ENIGMA: construct the integrated DE-ENIGMA platform and assess the impact DE-ENIGMA skill training compared to traditional therapies on autistic children’s socio-emotional skills.
- DE-ENIGMA Dissemination, Communication and Exploitation
- To create public, scientific and industrial awareness of the project achievements. Dissemination and exploitation activities will be performed in strict relation with all the technical activities
- Dissemination strategy
- Organisation of challenges and benchmarking
- To create public, scientific and industrial awareness of the project achievements. Dissemination and exploitation activities will be performed in strict relation with all the technical activities
- DE-ENIGMA Management
- To implement all technical, financial and administrative aspects of the project plan to ensure that it is executed in fulfillment of the contract with the European Commission.
- Project leadership and coordination
- Administrative and financial management
- Quality assurance and risk management
- Preparation for review of progress
- To implement all technical, financial and administrative aspects of the project plan to ensure that it is executed in fulfillment of the contract with the European Commission.
010702 BUCUREST
Romania