Peculiarities of the Emotions Manifestation by 7–8 Old Children in Speech and Facial Expressions
- Authors: Kleshnev E.A.1, Frolova O.V.1, Lyakso E.E.1
-
Affiliations:
- Saint-Petersburg State University
- Issue: Vol 110, No 4 (2024)
- Pages: 605-623
- Section: EXPERIMENTAL ARTICLES
- URL: https://journals.rcsi.science/0869-8139/article/view/265023
- DOI: https://doi.org/10.31857/S0869813924040077
- EDN: https://elibrary.ru/CNMFCD
- ID: 265023
Cite item
Abstract
The purpose of the research was to study the characteristics of the reflection of emotional states “neutral (calm state) –– sadness –– joy – anger – fear” in the speech and facial expressions of children 7–8 years old and to identify differences in the expression of emotions by boys and girls of this age. The work was carried out as part of a study of the emotional sphere of children with typical and atypical development using the CEDM method for assessing the emotional development of children. 14 children (7 boys, 7 girls) – primary school students – took part in the study. The ability of children to reflect emotions in the characteristics of voice and facial expressions and to recognize emotions was analyzed. For this purpose, speech recording and video recording of children’s facial expressions and behavior, instrumental and perceptual analysis of emotional speech, and automatic analysis of facial expression were carried out. The children’s heart rate was recorded, and the dominant hemisphere was determined by speech using a dichotic test. The features of the reflection of the emotional states of boys and girls in the characteristics of speech are revealed. The specificity of reflecting the emotional states of children in facial expression is described. The connections between the psychophysiological indicators of children and their reflection of emotional states in their voice and facial expressions were determined.
Full Text
About the authors
E. A. Kleshnev
Saint-Petersburg State University
Author for correspondence.
Email: kleshnev.egor@gmail.com
Russian Federation, Saint Petersburg
O. V. Frolova
Saint-Petersburg State University
Email: kleshnev.egor@gmail.com
Russian Federation, Saint Petersburg
E. E. Lyakso
Saint-Petersburg State University
Email: lyakso@gmail.com
Russian Federation, Saint Petersburg
References
- Ляксо ЕЕ, Фролова ОВ (ред) (2020) Голосовой портрет ребенка с типичным и атипичным развитием. СПб. Издат-полиграф ассоциация высш учебн завед. [Lyakso EE, Frolova OV (eds) (2020) Voice portrait of a child with typical and atypical devel. Publ house-polygraph association of higher educat institut. (In Russ)].
- Ekman P (1982) Methods for measuring facial action. Handbook of methods in nonverbal behavior research. New York. Cambridge Univer Press.
- Izard CE (1977) Theories of Emotion and Emotion-Behavior Relationships. Hum Emot 19–42. https://doi.org/10.1007/978-1-4899-2209-0_2
- Hudspeth WJ, Pribram KH (1990) Stages of Brain and Cognitive Maturation. J Educ Psychol 82: 881–884. https://doi.org/10.1037/0022-0663.82.4.881
- Hudspeth WJ, Pribram KH (1992) Psychophysiological indices of cerebral maturation. Int J Psychophysiol 12: 19–29. https://doi.org/10.1016/0167-8760(92)90039-E
- Hernández MM, Eisenberg N, Valiente C, Spinrad TL, Berger RH, VanSchyndel SK, Silva KM, Diaz A, Thompson MS, Gal DE, Southworth J (2018) Bidirectional associations between emotions and school adjustment. J Pers 86: 853–867. https://doi.org/10.1111/jopy.12361
- De Bordes PF, Hasselman F, Cox RFA (2021) Children’s perception of facial expressions. Dev Psychol 57: 506–518. https://doi.org/10.1037/DEV0000979
- Thrasher C, Grossmann T (2021) Children’s emotion perception in context: The role of caregiver touch and relationship quality. Emotion 21: 273–282. https://doi.org/10.1037/EMO0000704
- Jones DC, Abbey BB, Cumberland A (1998) The Development of Display Rule Knowledge: Linkages with Family Expressiveness and Social Competence. Child Dev 69: 1209–1222. https://doi.org/10.1111/J.1467-8624.1998.TB06168.X
- Sauter DA, Panattoni C, Happé F (2013) Children’s recognition of emotions from vocal cues. Br J Dev Psychol 31: 97–113. https://doi.org/10.1111/J.2044-835X.2012.02081.X
- Casey BJ, Heller AS, Gee DG, Cohen AO (2019) Development of the emotional brain. Neurosci Lett 693: 29–34. https://doi.org/10.1016/J.NEULET.2017.11.055
- Plessen KJ, Kabicheva G (2010) Hjernen og følelser – fra barn til voksen. Tidsskr den Nor Laegeforening 130: 932–935. https://doi.org/10.4045/TIDSSKR.09.0255
- Giedd JN, Blumenthal J, Jeffries NO, Castellanos FX, Liu H, Zijdenbos A, Paus T, Evans AC, Rapoport JL (1999) Brain development during childhood and adolescence: a longitudinal MRI study. Nat Neurosci 1999 210 2: 861–863. https://doi.org/10.1038/13158
- Widen SC (2013) Children’s interpretation of facial expressions: The long path from valence-based to specific discrete categories. Emot Rev 5: 72–77. https://doi.org/10.1177/1754073912451492
- Covic A, Von Steinbüchel N, Kiese-Himmel C (2020) Emotion Recognition in Kindergarten Children. Folia Phoniatr Logop 72. https://doi.org/10.1159/000500589
- Brechet C (2017) Children’s Recognition of Emotional Facial Expressions Through Photographs and Drawings. J Genet Psychol 178: 139–146. https://doi.org/10.1080/00221325.2017.1286630
- Kawahara M, Sauter DA, Tanaka A (2021) Culture shapes emotion perception from faces and voices: changes over development. Cogn Emot 35: 1175–1186. https://doi.org/10.1080/02699931.2021.1922361
- Дмитриева ЕС, Гельман ВЯ (2018) Восприятие эмоциональной слуховой и зрительной информации и успешность обучения младших школьников. Психол наука и образов 23: 29–39 [Dmitrieva ES, Gel’man VYa (2018) Perception of emotional auditory and visual information and the success of learning in younger schoolchildren. Psiholog nauka i obrazovan 23: 29–39. (In Russ)].
- Дмитриева ЕС, Гельман ВЯ, Зайцева КА, Орлова АМ (2006) Исследование восприятия эмоциональной составляющей речевого сигнала при разной длительности стимула. Физиол челов 32: 36–41. [Dmitrieva ES, Gel’man VYa, Zajceva KA, Orlova AM (2006) Study of the perception of the emotional component of a speech signal at different stimulus durations. Fiziol chelov 32: 36–41. (In Russ)].
- Дмитриева ЕС, Андерсон МН, Гельман ВЯ (2016) Сравнительное исследование зрительного и слухового восприятия эмоций детьми младшего школьного возраста. Эксперим психол 9: 38–52. [Dmitrieva ES, Anderson MN, Gel’man VYa (2016) A comparative study of visual and auditory perception of emotions in children of primary school age. Eksper psihol 9: 38–52. (In Russ)].
- Paine AL, van Goozen SHM, Burley DT, Anthony R, Shelton KH (2023) Facial emotion recognition in adopted children. Eur Child Adolesc Psychiatry 32: 87–99. https://doi.org/10.1007/S00787-021-01829-Z/TABLES/3
- Cannon SA, Chatterjee M (2019) Voice Emotion Recognition by Children with Mild-to-Moderate Hearing Loss. Ear Hear 40: 477–492. https://doi.org/10.1097/AUD.0000000000000637
- Maire J, Galera C, Roux S, Bioulac S, Bouvard M, Michel G (2019) Facial emotion recognition in children with or without Attention Deficit/Hyperactivity Disorder: Impact of comorbidity. Encephale 45: 114–120. https://doi.org/10.1016/J.ENCEP.2018.01.006
- Liu Z, Liu J, Zhang Z, Yu H, Hu F (2020) Facial Emotion Recognition and Polymorphisms of Dopaminergic Pathway Genes in Children with ASD. Behav Neurol 4: 6376842. https://doi.org/10.1155/2020/6376842
- Portnova GV, Skorokhodov IV, Mayorova LA (2023) The Levels of Auditory Processing during Emotional Perception in Children with Autism. J Integr Neurosci 22: 112. https://doi.org/10.31083/J.JIN2205112/2279F1232C14CCC07A661F8C52328386
- Löytömäki J, Laakso ML, Huttunen K (2023) Social-Emotional and Behavioural Difficulties in Children with Neurodevelopmental Disorders: Emotion Perception in Daily Life and in a Formal Assessment Context. J Autism Dev Disord 53: 4744–4758. https://doi.org/10.1007/S10803-022-05768-9/FIGURES/3
- Li HCW, Lopez V (2005) Children’s Emotional Manifestation Scale: development and testing. J Clin Nurs 14: 223–229. https://doi.org/10.1111/J.1365-2702.2004.01031.X
- Lyakso E, Frolova O, Matveev Y (2020) Facial expression: Psychophysiological study. Handb Res Deep Learn Image Anal Under Constrained Unconstrained Environ 266–289. https://doi.org/10.4018/978-1-7998-6690-9.CH014
- Jones AC, Gutierrez R, Ludlow AK (2021) Emotion production of facial expressions: A comparison of deaf and hearing children. J Commun Disord 92: 106113. https://doi.org/10.1016/J.JCOMDIS.2021.106113
- Chaplin TM, Aldao A (2013) Gender differences in emotion expression in children: A meta-analytic review. Psychol Bull 139: 735–765. https://doi.org/10.1037/A0030737
- Lyakso E, Frolova O (2015) Emotion state manifestation in voice features: Chimpanzees, human infants, children, adults. Lect Notes Comput Sci (includ Subser Lect Notes Artif Intell Lect Notes Bioinformat) 9319: 201–208. https://doi.org/10.1007/978-3-319-23132-7_25
- Lyakso E, Frolova O, Ruban N, Mekala AM (2021) Child’s Emotional Speech Classification by Human Across Two Languages: Russian & Tamil. Lect Notes Comput Sci (includ Subser Lect Notes Artif Intell Lect Notes Bioinformat) 12997 LNAI: 384–396. https://doi.org/10.1007/978-3-030-87802-3_35
- Lyakso EE, Frolova OV, Nikolaev AS, Grigorev AS (2022) Perceptual Analysis by Adults of the Speech of Children with Autism Spectrum Disorders, Down’s Syndrome, and Intellectual Disabilities. Neurosci Behav Physiol 52: 582–590. https://doi.org/10.1007/S11055-022-01279-3
- Frolova O, Nikolaev A, Grave P, Lyakso E (2023) Speech Features of Children with Mild Intellectual Disabilities. ACM Int Conf Proceed Ser 406–413. https://doi.org/10.1145/3610661.3616236
- Deschamps PKH, Been M, Matthys W (2014) Empathy and empathy induced prosocial behavior in 6 and 7 year-olds with autism spectrum disorder. J Autism Dev Disord 44: 1749–1758. https://doi.org/10.1007/s10803-014-2048-3
- Charman T, Ricketts J, Dockrell JE, Lindsay G, Palikara O (2015) Emotional and behavioural problems in children with language impairments and children with autism spectrum disorders. Int J Lang Commun Disord 50: 84–93. https://doi.org/10.1111/1460-6984.12116
- Baron-Cohen S, Golan O, Ashwin E (2009) Can emotion recognition be taught to children with autism spectrum conditions? Philos Trans R Soc B 364: 3567–3574. https://doi.org/10.1098/rstb.2009.0191
- Lyakso E, Frolova O, Kleshnev E, Ruban N, Mary Mekala A, Arulalan KV (2022) Approbation of the Child’s Emotional Development Method (CEDM). ACM Int Conf Proceed Ser 201–210. https://doi.org/10.1145/3536220.3563371
- Lyakso E, Ruban N, Frolova O, Mekala MA (2023) The children’s emotional speech recognition by adults: Cross-cultural study on Russian and Tamil language. PLoS One 18: e0272837. https://doi.org/10.1371/JOURNAL.PONE.0272837
- Castro SL, Lima CF (2010) Recognizing emotions in spoken language: a validated set of Portuguese sentences and pseudosentences for research on emotional prosody. Behav Res Methods 42: 74–81. https://doi.org/10.3758/BRM.42.1.74
- Gilam G, Hendler T (2016) Deconstructing anger in the human brain. Curr Top Behav Neurosci 30: 257–273. https://doi.org/10.1007/7854_2015_408
- Glokaya kuzdra. : languagehat.com. https://languagehat.com/glokaya-kuzdra/
- Вартанян ИА, Галунов ВИ, Дмитриева ЕС, Морозов ВП (1988) Восприятие речи. Вопросы функциональной асимметрии мозга. СПб. Наука. [Vartanyan IA, Galunov VI, Dmitrieva ES, Morozov VP (1988) Speech perception. Issues of functional brain asymmetry. SPb. Nauka. (In Russ)].
- McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med 22: 276. https://doi.org/10.11613/bm.2012.031
- Rashidah N, Juremi MD, Zulkifley MA, Hussain A, Diyana WM, Zaki W (2017) Inter-rater reliability of actual tagged emotion categories validation using Cohen’s Kappa coefficient. J Theor Appl Inf Technol 2017. https://jatit.org/
- Laukka P, Thingujam NS, Iraki FK, Elfenbein HA, Rockstuhl T, Chui W, Althoff J (2016) The expression and recognition of emotions in the voice across five nations: A lens model analysis based on acoustic features. J Pers Soc Psychol 111: 686–705. https://doi.org/10.1037/PSPI0000066
- Liu P, Pell MD (2012) Recognizing vocal emotions in Mandarin Chinese: a validated database of Chinese vocal emotional stimuli. Behav Res Methods 44: 1042–1051. https://doi.org/10.3758/S13428-012-0203-3
- Juslin PN, Laukka P (2003) Communication of emotions in vocal expression and music performance: different channels, same code? Psychol Bull 129: 770–814. https://doi.org/10.1037/0033-2909.129.5.770
- Scherer KR (1995) Expression of emotion in voice and music. J Voice 9: 235–248. https://doi.org/10.1016/S0892-1997(05)80231-0
- Nwokah EE, Davies P, Islam A, Hsu H, Fogel A (1993) Vocal affect in three-year-olds: A quantitative acoustic analysis of child laughter. J Acoust Soc Am 94: 3076–3090. https://doi.org/10.1121/1.407242
- Scherer KR (2003) Vocal communication of emotion: A review of research paradigms. Speech Commun 40: 227–256. https://doi.org/10.1016/S0167-6393(02)00084-5
- Ekman P, Levenson RW, Friesen WV (1983) Autonomic Nervous System Activity Distinguishes Among Emotions. Science 221: 1208–1210. https://doi.org/10.1126/SCIENCE.6612338
- Морозов ВП (2013) Эмоциональный слух. Экспериментально-психологические исследования. Психол журн 34: 45–62. [Morozov VP (2013) Emotional hearing. Experimental-psychological research. Psihol zhurn 34: 45–62. (In Russ)].
- Patel S, Oishi K, Wright A, Sutherland-Foggio H, Saxena S, Sheppard SM, Hillis AE (2018) Right Hemisphere Regions Critical for Expression of Emotion Through Prosody. Front Neurol 9. https://doi.org/10.3389/FNEUR.2018.00224
- Shapiro BE, Danly M (1985) The role of the right hemisphere in the control of speech prosody in propositional and affective contexts. Brain Lang 25: 19–36. https://doi.org/10.1016/0093-934X(85)90118-X
- Lindell AK (2006) In your right mind: Right hemisphere contributions to language processing and production. Neuropsychol Rev 16: 131–148. https://doi.org/10.1007/S11065-006-9011-9/METRICS