TY - JOUR
T1 - Automatic Emotion Recognition in Children with Autism: A Systematic Literature Review
AU - Landowska , Agnieszka
AU - Karpus, Aleksandra
AU - Zawadzka, Teresa
AU - Robins, Ben
AU - Erol Barkana, Duygun
AU - Kose , Hatice
AU - Zorcec, Tatjana
AU - Cummins, Nicholas
N1 - Funding Information:
This publication was co-funded by the Erasmus Plus project of European Commission: EMBOA, Affective loop in Socially Assistive Robotics as an intervention tool for children with autism, contract no 2019-1-PL01-KA203-065096. This publication reflects the views only of the author, and the Commission cannot be held responsible for any use which may be made of the information contained therein.
Publisher Copyright:
© 2022 by the authors. Licensee MDPI, Basel, Switzerland.
PY - 2022/2/20
Y1 - 2022/2/20
N2 - The automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities are used in the analyzed studies, including facial expressions, prosody of speech, and physiological signals. Regarding representation models, the basic emotions are the most frequently recognized, especially happiness, fear, and sadness. Both single-channel and multichannel approaches are applied, with a preference for the first one. For multimodal recognition, early fusion was the most frequently applied. SVM and neural networks were the most popular for building classifiers. Qualitative analysis revealed important clues on participant group construction and the most common combinations of modalities and methods. All channels are reported to be prone to some disturbance, and as a result, information on a specific symptoms of emotions might be temporarily or permanently unavailable. The challenges of proper stimuli, labelling methods, and the creation of open datasets were also identified.
AB - The automatic emotion recognition domain brings new methods and technologies that might be used to enhance therapy of children with autism. The paper aims at the exploration of methods and tools used to recognize emotions in children. It presents a literature review study that was performed using a systematic approach and PRISMA methodology for reporting quantitative and qualitative results. Diverse observation channels and modalities are used in the analyzed studies, including facial expressions, prosody of speech, and physiological signals. Regarding representation models, the basic emotions are the most frequently recognized, especially happiness, fear, and sadness. Both single-channel and multichannel approaches are applied, with a preference for the first one. For multimodal recognition, early fusion was the most frequently applied. SVM and neural networks were the most popular for building classifiers. Qualitative analysis revealed important clues on participant group construction and the most common combinations of modalities and methods. All channels are reported to be prone to some disturbance, and as a result, information on a specific symptoms of emotions might be temporarily or permanently unavailable. The challenges of proper stimuli, labelling methods, and the creation of open datasets were also identified.
UR - http://www.scopus.com/inward/record.url?scp=85124884893&partnerID=8YFLogxK
U2 - doi.org/10.3390/s22041649
DO - doi.org/10.3390/s22041649
M3 - Review article
SN - 1424-8220
VL - 22
SP - 1649
JO - SENSORS
JF - SENSORS
IS - 4
M1 - 1649
ER -