A selection of research projects that I have been involved with:
ZD.B Fellowship: An Embedded Soundscape System for Personalised Wellness via Multimodal Bio-Signal and Speech Monitoring
Runtime: 01.01.2017 – 31.12.2020
The soundscape (the audible components of a given environment), is an omnipresence in daily-life. Yet research has shown, that elements of our acoustic soundscapes can negatively affect mental wellbeing. Taking a dual analysis-synthesis approach this project, through multimodal feedback analysis, will explore the benefits of synthesised soundscape design and develop a ‘deep-listening’ personalised embedded system to improve human wellness. The project will explore questions pertaining to audible perception and develop novel methods for soundscape generation, informed by intelligent signal state monitoring.
DE-ENIGMA: Multi-Modal Human-Robot Interaction for Teaching and Expanding Social Imagination in Autistic Children (#688835)
EU Horizon 2020 Research & Innovation Action (RIA)
Runtime: 01.02.2016 – 31.07.2019
The overall aim of the DE-ENIGMA project is to realise robust, context-sensitive, multimodal and naturalistic human-robot interaction (HRI) aimed at enhancing the social imagination skills of children with autism.
This extends and contrasts considerably to the current state of the art in existing technological solutions to machine analysis of the facial, bodily, vocal and verbal behaviour that are used in (commercially and otherwise) available human-centric HRI applications.
Realising an on-going effective dialogue between the child and the robot as part of a therapeutic process to teach the children socio-emotional skills such as recognising and displaying appropriate emotions and social behaviours in relevant contexts also requires effective robot behaviour planning and execution.