Peculiarities of the Emotions Manifestation by 7–8 Old Children in Speech and Facial Expressions

Capa

Citar

Texto integral

Acesso aberto Acesso aberto
Acesso é fechado Acesso está concedido
Acesso é fechado Somente assinantes

Resumo

The purpose of the research was to study the characteristics of the reflection of emotional states “neutral (calm state) –– sadness –– joy – anger – fear” in the speech and facial expressions of children 7–8 years old and to identify differences in the expression of emotions by boys and girls of this age. The work was carried out as part of a study of the emotional sphere of children with typical and atypical development using the CEDM method for assessing the emotional development of children. 14 children (7 boys, 7 girls) – primary school students – took part in the study. The ability of children to reflect emotions in the characteristics of voice and facial expressions and to recognize emotions was analyzed. For this purpose, speech recording and video recording of children’s facial expressions and behavior, instrumental and perceptual analysis of emotional speech, and automatic analysis of facial expression were carried out. The children’s heart rate was recorded, and the dominant hemisphere was determined by speech using a dichotic test. The features of the reflection of the emotional states of boys and girls in the characteristics of speech are revealed. The specificity of reflecting the emotional states of children in facial expression is described. The connections between the psychophysiological indicators of children and their reflection of emotional states in their voice and facial expressions were determined.

Texto integral

Acesso é fechado

Sobre autores

E. Kleshnev

Saint-Petersburg State University

Autor responsável pela correspondência
Email: kleshnev.egor@gmail.com
Rússia, Saint Petersburg

O. Frolova

Saint-Petersburg State University

Email: kleshnev.egor@gmail.com
Rússia, Saint Petersburg

E. Lyakso

Saint-Petersburg State University

Email: lyakso@gmail.com
Rússia, Saint Petersburg

Bibliografia

  1. Ляксо ЕЕ, Фролова ОВ (ред) (2020) Голосовой портрет ребенка с типичным и атипичным развитием. СПб. Издат-полиграф ассоциация высш учебн завед. [Lyakso EE, Frolova OV (eds) (2020) Voice portrait of a child with typical and atypical devel. Publ house-polygraph association of higher educat institut. (In Russ)].
  2. Ekman P (1982) Methods for measuring facial action. Handbook of methods in nonverbal behavior research. New York. Cambridge Univer Press.
  3. Izard CE (1977) Theories of Emotion and Emotion-Behavior Relationships. Hum Emot 19–42. https://doi.org/10.1007/978-1-4899-2209-0_2
  4. Hudspeth WJ, Pribram KH (1990) Stages of Brain and Cognitive Maturation. J Educ Psychol 82: 881–884. https://doi.org/10.1037/0022-0663.82.4.881
  5. Hudspeth WJ, Pribram KH (1992) Psychophysiological indices of cerebral maturation. Int J Psychophysiol 12: 19–29. https://doi.org/10.1016/0167-8760(92)90039-E
  6. Hernández MM, Eisenberg N, Valiente C, Spinrad TL, Berger RH, VanSchyndel SK, Silva KM, Diaz A, Thompson MS, Gal DE, Southworth J (2018) Bidirectional associations between emotions and school adjustment. J Pers 86: 853–867. https://doi.org/10.1111/jopy.12361
  7. De Bordes PF, Hasselman F, Cox RFA (2021) Children’s perception of facial expressions. Dev Psychol 57: 506–518. https://doi.org/10.1037/DEV0000979
  8. Thrasher C, Grossmann T (2021) Children’s emotion perception in context: The role of caregiver touch and relationship quality. Emotion 21: 273–282. https://doi.org/10.1037/EMO0000704
  9. Jones DC, Abbey BB, Cumberland A (1998) The Development of Display Rule Knowledge: Linkages with Family Expressiveness and Social Competence. Child Dev 69: 1209–1222. https://doi.org/10.1111/J.1467-8624.1998.TB06168.X
  10. Sauter DA, Panattoni C, Happé F (2013) Children’s recognition of emotions from vocal cues. Br J Dev Psychol 31: 97–113. https://doi.org/10.1111/J.2044-835X.2012.02081.X
  11. Casey BJ, Heller AS, Gee DG, Cohen AO (2019) Development of the emotional brain. Neurosci Lett 693: 29–34. https://doi.org/10.1016/J.NEULET.2017.11.055
  12. Plessen KJ, Kabicheva G (2010) Hjernen og følelser – fra barn til voksen. Tidsskr den Nor Laegeforening 130: 932–935. https://doi.org/10.4045/TIDSSKR.09.0255
  13. Giedd JN, Blumenthal J, Jeffries NO, Castellanos FX, Liu H, Zijdenbos A, Paus T, Evans AC, Rapoport JL (1999) Brain development during childhood and adolescence: a longitudinal MRI study. Nat Neurosci 1999 210 2: 861–863. https://doi.org/10.1038/13158
  14. Widen SC (2013) Children’s interpretation of facial expressions: The long path from valence-based to specific discrete categories. Emot Rev 5: 72–77. https://doi.org/10.1177/1754073912451492
  15. Covic A, Von Steinbüchel N, Kiese-Himmel C (2020) Emotion Recognition in Kindergarten Children. Folia Phoniatr Logop 72. https://doi.org/10.1159/000500589
  16. Brechet C (2017) Children’s Recognition of Emotional Facial Expressions Through Photographs and Drawings. J Genet Psychol 178: 139–146. https://doi.org/10.1080/00221325.2017.1286630
  17. Kawahara M, Sauter DA, Tanaka A (2021) Culture shapes emotion perception from faces and voices: changes over development. Cogn Emot 35: 1175–1186. https://doi.org/10.1080/02699931.2021.1922361
  18. Дмитриева ЕС, Гельман ВЯ (2018) Восприятие эмоциональной слуховой и зрительной информации и успешность обучения младших школьников. Психол наука и образов 23: 29–39 [Dmitrieva ES, Gel’man VYa (2018) Perception of emotional auditory and visual information and the success of learning in younger schoolchildren. Psiholog nauka i obrazovan 23: 29–39. (In Russ)].
  19. Дмитриева ЕС, Гельман ВЯ, Зайцева КА, Орлова АМ (2006) Исследование восприятия эмоциональной составляющей речевого сигнала при разной длительности стимула. Физиол челов 32: 36–41. [Dmitrieva ES, Gel’man VYa, Zajceva KA, Orlova AM (2006) Study of the perception of the emotional component of a speech signal at different stimulus durations. Fiziol chelov 32: 36–41. (In Russ)].
  20. Дмитриева ЕС, Андерсон МН, Гельман ВЯ (2016) Сравнительное исследование зрительного и слухового восприятия эмоций детьми младшего школьного возраста. Эксперим психол 9: 38–52. [Dmitrieva ES, Anderson MN, Gel’man VYa (2016) A comparative study of visual and auditory perception of emotions in children of primary school age. Eksper psihol 9: 38–52. (In Russ)].
  21. Paine AL, van Goozen SHM, Burley DT, Anthony R, Shelton KH (2023) Facial emotion recognition in adopted children. Eur Child Adolesc Psychiatry 32: 87–99. https://doi.org/10.1007/S00787-021-01829-Z/TABLES/3
  22. Cannon SA, Chatterjee M (2019) Voice Emotion Recognition by Children with Mild-to-Moderate Hearing Loss. Ear Hear 40: 477–492. https://doi.org/10.1097/AUD.0000000000000637
  23. Maire J, Galera C, Roux S, Bioulac S, Bouvard M, Michel G (2019) Facial emotion recognition in children with or without Attention Deficit/Hyperactivity Disorder: Impact of comorbidity. Encephale 45: 114–120. https://doi.org/10.1016/J.ENCEP.2018.01.006
  24. Liu Z, Liu J, Zhang Z, Yu H, Hu F (2020) Facial Emotion Recognition and Polymorphisms of Dopaminergic Pathway Genes in Children with ASD. Behav Neurol 4: 6376842. https://doi.org/10.1155/2020/6376842
  25. Portnova GV, Skorokhodov IV, Mayorova LA (2023) The Levels of Auditory Processing during Emotional Perception in Children with Autism. J Integr Neurosci 22: 112. https://doi.org/10.31083/J.JIN2205112/2279F1232C14CCC07A661F8C52328386
  26. Löytömäki J, Laakso ML, Huttunen K (2023) Social-Emotional and Behavioural Difficulties in Children with Neurodevelopmental Disorders: Emotion Perception in Daily Life and in a Formal Assessment Context. J Autism Dev Disord 53: 4744–4758. https://doi.org/10.1007/S10803-022-05768-9/FIGURES/3
  27. Li HCW, Lopez V (2005) Children’s Emotional Manifestation Scale: development and testing. J Clin Nurs 14: 223–229. https://doi.org/10.1111/J.1365-2702.2004.01031.X
  28. Lyakso E, Frolova O, Matveev Y (2020) Facial expression: Psychophysiological study. Handb Res Deep Learn Image Anal Under Constrained Unconstrained Environ 266–289. https://doi.org/10.4018/978-1-7998-6690-9.CH014
  29. Jones AC, Gutierrez R, Ludlow AK (2021) Emotion production of facial expressions: A comparison of deaf and hearing children. J Commun Disord 92: 106113. https://doi.org/10.1016/J.JCOMDIS.2021.106113
  30. Chaplin TM, Aldao A (2013) Gender differences in emotion expression in children: A meta-analytic review. Psychol Bull 139: 735–765. https://doi.org/10.1037/A0030737
  31. Lyakso E, Frolova O (2015) Emotion state manifestation in voice features: Chimpanzees, human infants, children, adults. Lect Notes Comput Sci (includ Subser Lect Notes Artif Intell Lect Notes Bioinformat) 9319: 201–208. https://doi.org/10.1007/978-3-319-23132-7_25
  32. Lyakso E, Frolova O, Ruban N, Mekala AM (2021) Child’s Emotional Speech Classification by Human Across Two Languages: Russian & Tamil. Lect Notes Comput Sci (includ Subser Lect Notes Artif Intell Lect Notes Bioinformat) 12997 LNAI: 384–396. https://doi.org/10.1007/978-3-030-87802-3_35
  33. Lyakso EE, Frolova OV, Nikolaev AS, Grigorev AS (2022) Perceptual Analysis by Adults of the Speech of Children with Autism Spectrum Disorders, Down’s Syndrome, and Intellectual Disabilities. Neurosci Behav Physiol 52: 582–590. https://doi.org/10.1007/S11055-022-01279-3
  34. Frolova O, Nikolaev A, Grave P, Lyakso E (2023) Speech Features of Children with Mild Intellectual Disabilities. ACM Int Conf Proceed Ser 406–413. https://doi.org/10.1145/3610661.3616236
  35. Deschamps PKH, Been M, Matthys W (2014) Empathy and empathy induced prosocial behavior in 6 and 7 year-olds with autism spectrum disorder. J Autism Dev Disord 44: 1749–1758. https://doi.org/10.1007/s10803-014-2048-3
  36. Charman T, Ricketts J, Dockrell JE, Lindsay G, Palikara O (2015) Emotional and behavioural problems in children with language impairments and children with autism spectrum disorders. Int J Lang Commun Disord 50: 84–93. https://doi.org/10.1111/1460-6984.12116
  37. Baron-Cohen S, Golan O, Ashwin E (2009) Can emotion recognition be taught to children with autism spectrum conditions? Philos Trans R Soc B 364: 3567–3574. https://doi.org/10.1098/rstb.2009.0191
  38. Lyakso E, Frolova O, Kleshnev E, Ruban N, Mary Mekala A, Arulalan KV (2022) Approbation of the Child’s Emotional Development Method (CEDM). ACM Int Conf Proceed Ser 201–210. https://doi.org/10.1145/3536220.3563371
  39. Lyakso E, Ruban N, Frolova O, Mekala MA (2023) The children’s emotional speech recognition by adults: Cross-cultural study on Russian and Tamil language. PLoS One 18: e0272837. https://doi.org/10.1371/JOURNAL.PONE.0272837
  40. Castro SL, Lima CF (2010) Recognizing emotions in spoken language: a validated set of Portuguese sentences and pseudosentences for research on emotional prosody. Behav Res Methods 42: 74–81. https://doi.org/10.3758/BRM.42.1.74
  41. Gilam G, Hendler T (2016) Deconstructing anger in the human brain. Curr Top Behav Neurosci 30: 257–273. https://doi.org/10.1007/7854_2015_408
  42. Glokaya kuzdra. : languagehat.com. https://languagehat.com/glokaya-kuzdra/
  43. Вартанян ИА, Галунов ВИ, Дмитриева ЕС, Морозов ВП (1988) Восприятие речи. Вопросы функциональной асимметрии мозга. СПб. Наука. [Vartanyan IA, Galunov VI, Dmitrieva ES, Morozov VP (1988) Speech perception. Issues of functional brain asymmetry. SPb. Nauka. (In Russ)].
  44. McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Med 22: 276. https://doi.org/10.11613/bm.2012.031
  45. Rashidah N, Juremi MD, Zulkifley MA, Hussain A, Diyana WM, Zaki W (2017) Inter-rater reliability of actual tagged emotion categories validation using Cohen’s Kappa coefficient. J Theor Appl Inf Technol 2017. https://jatit.org/
  46. Laukka P, Thingujam NS, Iraki FK, Elfenbein HA, Rockstuhl T, Chui W, Althoff J (2016) The expression and recognition of emotions in the voice across five nations: A lens model analysis based on acoustic features. J Pers Soc Psychol 111: 686–705. https://doi.org/10.1037/PSPI0000066
  47. Liu P, Pell MD (2012) Recognizing vocal emotions in Mandarin Chinese: a validated database of Chinese vocal emotional stimuli. Behav Res Methods 44: 1042–1051. https://doi.org/10.3758/S13428-012-0203-3
  48. Juslin PN, Laukka P (2003) Communication of emotions in vocal expression and music performance: different channels, same code? Psychol Bull 129: 770–814. https://doi.org/10.1037/0033-2909.129.5.770
  49. Scherer KR (1995) Expression of emotion in voice and music. J Voice 9: 235–248. https://doi.org/10.1016/S0892-1997(05)80231-0
  50. Nwokah EE, Davies P, Islam A, Hsu H, Fogel A (1993) Vocal affect in three-year-olds: A quantitative acoustic analysis of child laughter. J Acoust Soc Am 94: 3076–3090. https://doi.org/10.1121/1.407242
  51. Scherer KR (2003) Vocal communication of emotion: A review of research paradigms. Speech Commun 40: 227–256. https://doi.org/10.1016/S0167-6393(02)00084-5
  52. Ekman P, Levenson RW, Friesen WV (1983) Autonomic Nervous System Activity Distinguishes Among Emotions. Science 221: 1208–1210. https://doi.org/10.1126/SCIENCE.6612338
  53. Морозов ВП (2013) Эмоциональный слух. Экспериментально-психологические исследования. Психол журн 34: 45–62. [Morozov VP (2013) Emotional hearing. Experimental-psychological research. Psihol zhurn 34: 45–62. (In Russ)].
  54. Patel S, Oishi K, Wright A, Sutherland-Foggio H, Saxena S, Sheppard SM, Hillis AE (2018) Right Hemisphere Regions Critical for Expression of Emotion Through Prosody. Front Neurol 9. https://doi.org/10.3389/FNEUR.2018.00224
  55. Shapiro BE, Danly M (1985) The role of the right hemisphere in the control of speech prosody in propositional and affective contexts. Brain Lang 25: 19–36. https://doi.org/10.1016/0093-934X(85)90118-X
  56. Lindell AK (2006) In your right mind: Right hemisphere contributions to language processing and production. Neuropsychol Rev 16: 131–148. https://doi.org/10.1007/S11065-006-9011-9/METRICS

Arquivos suplementares

Arquivos suplementares
Ação
1. JATS XML
Baixar
2. Fig. 1. The program "FaceReader 8v." is a mimic expression of a state of joy (a boy of 8 years old).

Baixar (153KB)
Metadados
3. Fig. 2. The values of the frequency of the basic tone of the "acting" speech of boys and girls in emotional states – neutral, sadness, joy, anger, fear. Emotional states are marked on the horizontal axis, values of F0, Hz are marked on the vertical axis. Columns m are values of F0 for boys, columns f are values of F0 for girls. *** ‒ p < 0.001 – Mann–Whitney criterion, differences between boys and girls.

Baixar (75KB)
Metadados
4. Fig. 3. The frequency of emotions in children's facial expressions. Emotional states are indicated along the horizontal axis, and the frequency of emotion in the child's facial expressions is indicated along the vertical axis. Columns m are the frequency of emotion in boys, columns f are the frequency of emotion in girls. * ‒ p < 0.05 – Mann–Whitney criterion, differences between boys and girls.

Baixar (75KB)
Metadados

Declaração de direitos autorais © Russian Academy of Sciences, 2024

Este site utiliza cookies

Ao continuar usando nosso site, você concorda com o procedimento de cookies que mantêm o site funcionando normalmente.

Informação sobre cookies