Methodology of the neurophysiological experiments with visual stimuli to assess foreign language proficiency

Cover Page

Cite item

Full Text

Abstract

Aim of this study is to compare different experimental paradigms and to determine parameters suitable for conducting a neurophysiological experiment with visual stimuli to assess foreign language proficiency and providing further time series analysis of electrical brain activity to reveal specific biomarkers. Methods. This paper explores the possibilities and limitations of various experimental studies using the metaanalysis paradigm. Statistical approaches are used to determine significance of the results. Results. We review the current state of research in the field of experimental works related to visual stimulus presentation and verbal performance acquisition. Generalizations and analytical estimates of the experimental parameters used in the studies are carried out to provide recommendations for future experimental research. Conclusion. In this area of applied research, we have developed experimental design and algorithms for working with multiple data sources. In addition, experimental encephalographic studies have been carried out, that allowed the optimal temporal structure selection.

About the authors

Alexander Nikolaevich Pisarchik

Universidad Politécnica de Madrid, Centre for Biomedical Technology; Innopolis University

28040 Madrid, Испания

Vladimir Sergeevich Khorev

Innopolis University; Saratov State University

1, Universitetskaya Str., Innopolis, 420500, Russia

Artem Aleksandrovich Badarin

Immanuel Kant Baltic Federal University

14 A. Nevskogo ul., Kaliningrad, 236041

Vladimir Mikhaylovich Antipov

Innopolis University

1, Universitetskaya Str., Innopolis, 420500, Russia

Anna Olegovna Budarina

Immanuel Kant Baltic Federal University

14 A. Nevskogo ul., Kaliningrad, 236041

Aleksandr Evgenevich Hramov

Immanuel Kant Baltic Federal University; Innopolis University; Lobachevsky State University of Nizhny Novgorod

14 A. Nevskogo ul., Kaliningrad, 236041

References

  1. Feiler J. B., Stabio M. E. Three pillars of educational neuroscience from three decades of literature // Trends in Neuroscience and Education. 2018. Vol. 13. P. 17–25. 10.1016/j.tine. 2018.11.001.
  2. Jolles J., Jolles D. D. On neuroeducation: Why and how to improve neuroscientific literacy in educational professionals // Front. Psychol. 2021. Vol. 12. P. 752151. doi: 10.3389/fpsyg. 2021.752151.
  3. Букина Т. В., Храмова М. В., Куркин С. А. Современные исследования функционирования мозга детей младшего школьного возраста в процессе обучения: обзор // Известия вузов. ПНД. 2021. T. 29, № 3. C. 449–456. doi: 10.18500/0869-6632-2021-29-3-449-456.
  4. Costa A., Santesteban M. Lexical access in bilingual speech production: Evidence from language switching in highly proficient bilinguals and L2 learners // Journal of Memory and Language. 2004. Vol. 50, no 4. P. 491–511. doi: 10.1016/j.jml.2004.02.002.
  5. Verhoef K., Roelofs A., Chwilla D. J. Role of inhibition in language switching: Evidence from event-related brain potentials in overt picture naming // Cognition. 2009. Vol. 110, no. 1. P. 84–99. doi: 10.1016/j.cognition.2008.10.013.
  6. Roelofs A., Piai V., Rodriguez G. G. Attentional inhibition in bilingual naming performance: evidence from delta-plot analyses // Front. Psychol. 2011. Vol. 2. P. 184. DOI: 10.3389/ fpsyg.2011.00184.
  7. Declerck M., Koch I., Philipp A. M. Digits vs. pictures: The influence of stimulus type on language switching // Bilingualism: Language and Cognition. 2012. Vol. 15, no. 4. P. 896–904. doi: 10.1017/S1366728912000193.
  8. Parker J. O., Green D. W., Grogan A., Pliatsikas C., Filippopolitis K., Ali N., Lee H. L., Ramsden S., Gazarian K., Prejawa S., Seghier M. L., Price C. J. Where, when and why brain activation differs for bilinguals and monolinguals during picture naming and reading aloud // Cereb. Cortex. 2012. Vol. 22, no. 4. P. 892–902. doi: 10.1093/cercor/bhr161.
  9. Allen D. B., Conklin K. Cross-linguistic similarity and task demands in Japanese-English bilingual processing // PLoS ONE. 2013. Vol. 8, no. 8. P. e72631. doi: 10.1371/journal.pone.0072631.
  10. Del Prato P., Pylkkanen L. MEG evidence for conceptual combination but not numeral quantification in the left anterior temporal lobe during language production // Front. Psychol. 2014. Vol. 5. P. 524. doi: 10.3389/fpsyg.2014.00524.
  11. Чхолак П., Табари Ф., Писарчик А. Н. Выявление нейронной сети, лежащей в основе парадигмы скрытого наименования изображений, с помощью магнитоэнцефалографии // Известия вузов. ПНД. 2022. T. 30, № 1. C. 76–95. doi: 10.18500/0869-6632-2022-30-1-76-95.
  12. Lensink S. E., Verdonschot R. G., Schiller N. O. Morphological priming during language switching: an ERP study // Front. Hum. Neurosci. 2014. Vol. 8. P. 995. doi: 10.3389/fnhum.2014.00995.
  13. Conner C. R., Chen G., Pieters T. A., Tandon N. Category specific spatial dissociations of parallel processes underlying visual naming // Cereb. Cortex. 2014. Vol. 24, no. 10. P. 2741–2750. doi: 10.1093/cercor/bht130.
  14. Sianipar A., Middelburg R., Dijkstra T. When feelings arise with meanings: How emotion and meaning of a native language affect second language processing in adult learners // PLoS ONE. 2015. Vol. 10, no. 12. P. e0144576. doi: 10.1371/journal.pone.0144576.
  15. Miozzo M., Pulvermuller F., Hauk O. Early parallel activation of semantics and phonology in picture naming: Evidence from a multiple linear regression MEG study // Cereb. Cortex. 2015. Vol. 25, no. 10. P. 3343–3355. doi: 10.1093/cercor/bhu137.
  16. Durlik J., Szewczyk J., Muszynski M., Wodniecka Z. Interference and inhibition in bilingual language comprehension: Evidence from Polish-English interlingual homographs // PLoS ONE. 2016. Vol. 11, no. 3. P. e0151430. doi: 10.1371/journal.pone.0151430.
  17. Bastarrika A., Davidson D. J. An event related field study of rapid grammatical plasticity in adult second-language learners // Front. Hum. Neurosci. 2017. Vol. 11. P. 12. doi: 10.3389/fnhum. 2017.00012.
  18. Bhatia D., Prasad S. G., Sake K., Mishra R. K. Task irrelevant external cues can influence language selection in voluntary object naming: Evidence from Hindi-English bilinguals // PLoS ONE. 2017. Vol. 12, no. 1. P. e0169284. doi: 10.1371/journal.pone.0169284.
  19. Blanco-Elorrieta E., Pylkkanen L. Bilingual language switching in the laboratory versus in the wild: The spatiotemporal dynamics of adaptive language control // J. Neurosci. 2017. Vol. 37, no. 37. P. 9022–9036. doi: 10.1523/JNEUROSCI.0553-17.2017.
  20. Mosca M., de Bot K. Bilingual language switching: Production vs. recognition // Front. Psychol. 2017. Vol. 8. P. 934. doi: 10.3389/fpsyg.2017.00934.
  21. Yang J., Ye J., Wang R., Zhou K., Wu Y. J. Bilingual contexts modulate the inhibitory control network // Front. Psychol. 2018. Vol. 9. P. 395. doi: 10.3389/fpsyg.2018.00395.
  22. Plat R., Lowie W., de Bot K. Word naming in the L1 and L2: A dynamic perspective on automatization and the degree of semantic involvement in naming // Front. Psychol. 2018. Vol. 8. P. 2256. doi: 10.3389/fpsyg.2017.02256.
  23. Forseth K. J., Kadipasaoglu C. M., Conner C. R., Hickok G., Knight R. T., Tandon N. A lexical semantic hub for heteromodal naming in middle fusiform gyrus // Brain. 2018. Vol. 141, no. 7. P. 2112–2126. doi: 10.1093/brain/awy120.
  24. Lavric A., Clapp A., East A., Elchlepp H., Monsell S. Is preparing for a language switch like preparing for a task switch? // Journal of Experimental Psychology: Learning, Memory, and Cognition. 2019. Vol. 45, no. 7. P. 1224–1233. doi: 10.1037/xlm0000636.
  25. Liu H., Zhang M., Perez A., Xie N., Li B., Liu Q. Role of language control during interbrain phase synchronization of cross-language communication // Neuropsychologia. 2019. Vol. 131. P. 316–324. doi: 10.1016/j.neuropsychologia.2019.05.014.
  26. Runnqvist E., Strijkers K., Costa A. Error-based learning and lexical competition in word production: Evidence from multilingual naming // PLoS ONE. 2019. Vol. 14, no. 3. P. e0213765. doi: 10.1371/journal.pone.0213765.
  27. Massa E., Kopke B., El Yagoubi R. Age-related effect on language control and executive control in bilingual and monolingual speakers: Behavioral and electrophysiological evidence // Neuropsychologia. 2020. Vol. 138. P. 107336. doi: 10.1016/j.neuropsychologia.2020.107336.
  28. Zhang Y., Cao N., Yue C., Dai L., Wu Y. J. The interplay between language form and concept during language switching: A behavioral investigation // Front. Psychol. 2020. Vol. 11. P. 791. doi: 10.3389/fpsyg.2020.00791.
  29. Zhu J. D., Seymour R. A., Szakay A., Sowman P. F. Neuro-dynamics of executive control in bilingual language switching: An MEG study // Cognition. 2020. Vol. 199. P. 104247. DOI: 10.1016/ j.cognition.2020.104247.
  30. Hofweber J., Marinis T., Treffers-Daller J. Experimentally induced language modes and regular code-switching habits boost bilinguals executive performance: Evidence from a within-subject paradigm // Front. Psychol. 2020. Vol. 11. P. 542326. doi: 10.3389/fpsyg.2020.542326.
  31. Tabassi Mofrad F., Jahn A., Schiller N. O. Dual function of primary somatosensory cortex in cognitive control of language: Evidence from resting state fMRI // Neuroscience. 2020. Vol. 446. P. 59–68. doi: 10.1016/j.neuroscience.2020.08.032.
  32. Schramm S., Tanigawa N., Tussis L., Meyer B., Sollmann N., Krieg S. M. Capturing multiple interaction effects in L1 and L2 object-naming reaction times in healthy bilinguals: a mixed-effects multiple regression analysis // BMC Neurosci. 2020. Vol. 21, no. 1. P. 3. doi: 10.1186/s12868- 020-0549-x.
  33. Weiss Lucas C., Pieczewski J., Kochs S., Nettekoven C., Grefkes C., Goldbrunner R., Jonas K. The cologne picture naming test for language mapping and monitoring (CoNaT): An open set of 100 black and white object drawings // Front. Neurol. 2021. Vol. 12. P. 633068. doi: 10.3389/fneur. 2021.633068.
  34. Wu R., Struys E. Language dominance and sociolinguistic experience are related to language control and domain-general monitoring control: An investigation in bilinguals who live in a minority/majority sociolinguistic setting // Front. Psychol. 2021. Vol. 12. P. 594648. DOI: 10.3389/ fpsyg.2021.594648.
  35. Kang X., Matthews S., Yip V., Wong P. C. M. Language and nonlanguage factors in foreign language learning: evidence for the learning condition hypothesis // npj Science of Learning. 2021. Vol. 6, no. 1. P. 28. doi: 10.1038/s41539-021-00104-9.
  36. Liu C., Li L., Jiao L., Wang R. Bilingual language control flexibly adapts to cultural context // Front. Psychol. 2021. Vol. 12. P. 744289. doi: 10.3389/fpsyg.2021.744289.
  37. Radman N., Jost L., Dorood S., Mancini C., Annoni J.-M. Language distance modulates cognitive control in bilinguals // Sci. Rep. 2021. Vol. 11, no. 1. P. 24131. doi: 10.1038/s41598-021-02973-x.
  38. Honari-Jahromi M., Chouinard B., Blanco-Elorrieta E., Pylkkanen L., Fyshe A. Neural representation of words within phrases: Temporal evolution of color-adjectives and object-nouns during simple composition // PLoS ONE. 2021.Vol. 16, no. 3. P. e0242754. doi: 10.1371/journal.pone.0242754.
  39. Verdonschot R. G., Phudng H. T. L., Tamaoka K. Phonological encoding in Vietnamese: An experimental investigation // Quarterly Journal of Experimental Psychology. 2022. Vol. 75, no. 7. P. 1355–1366. doi: 10.1177/17470218211053244.
  40. Visani E., Sebastiano D. R., Duran D., Garofalo G., Magliocco F., Silipo F., Buccino G. The semantics of natural objects and tools in the brain: A combined behavioral and MEG study // Brain Sci. 2022. Vol. 12, no. 1. P. 97. doi: 10.3390/brainsci12010097.
  41. Busch J. L., Haeussler F. S., Domahs F., Timmermann L., Weber I., Oehrn C. R. German normative data with naming latencies for 283 action pictures and 600 action verbs // Behavior Research Methods. 2022. Vol. 54, no. 2. P. 649–662. doi: 10.3758/s13428-021-01647-w.
  42. Krautz A. E., Keuleers E. LinguaPix database: A megastudy of picture-naming norms // Behavior Research Methods. 2022. Vol. 54, no. 2. P. 941–954. doi: 10.3758/s13428-021-01651-0.
  43. Wu R., Struys E. A domain-general monitoring account of bilingual language control in recognition: The role of language dominance and bilingual experience // Front. Psychol. 2022. Vol. 13. P. 854898. doi: 10.3389/fpsyg.2022.854898.
  44. Yang W., Gu Y., Fang Y., Sun Y. Mental representations of time in English monolinguals, Mandarin monolinguals, and Mandarin–English bilinguals // Front. Psychol. 2022. Vol. 13. P. 791197. doi: 10.3389/fpsyg.2022.791197.
  45. Baker D. H., Vilidaite G., Lygo F. A., Smith A. K., Flack T. R., Gouws A. D., Andrews T. J. Power contours: Optimising sample size and precision in experimental psychology and human neuroscience // Psychological Methods. 2021. Vol. 26, no. 3. P. 295–314. doi: 10.1037/met0000337.
  46. Walker G. M., Basilakos A., Fridriksson J., Hickok G. Beyond percent correct: Measuring change in individual picture naming ability // Journal of Speech, Language, and Hearing Research. 2022. Vol. 65, no. 1. P. 215–237. doi: 10.1044/2021_JSLHR-20-00205.
  47. Welford A. T. Choice Reaction Time: Basic Concepts. New York: Academic Press, 1980. 128 p.
  48. Jain A., Bansal R., Kumar A., Singh K. D. A comparative study of visual and auditory reaction times on the basis of gender and physical activity levels of medical first year students // International Journal of Applied and Basic Medical Research. 2015. Vol. 5, no. 2. P. 124–127. doi: 10.4103/2229-516X.157168.
  49. Fritsche M., Lawrence S. J. D., de Lange F. P. Temporal tuning of repetition suppression across the visual cortex // J. Neurophysiol. 2020. Vol. 123, no. 1. P. 224–233. doi: 10.1152/jn.00582.2019.
  50. Боровков А. А. Математическая статистика. Оценка параметров. Проверка гипотез: учебное пособие для мат. и физ. спец. вузов. М.: Наука, 1984. 472 с.
  51. Kostandov E. A., Cheremushkin E. A., Yakovenko I. A., Petrenko N. E. Induced synchronization of the alpha rhythm during the pauses between visual stimuli with different levels of cognitive set plasticity // Neuroscience and Behavioral Physiology. 2015. Vol. 45, no. 2. P. 154–163. doi: 10.1007/s11055-015-0053-4.
  52. Babiloni C., Miniussi C., Babiloni F., Carducci F., Cincotti F., Del Percio C., Sirello G., Fracassi C., Nobre A. C., Rossini P. M. Sub-second "temporal attention" modulates alpha rhythms. A high-resolution EEG study // Cognitive Brain Research. 2004. Vol. 19, no. 3. P. 259–268. doi: 10.1016/j.cogbrainres.2003.12.010.
  53. Coull J. T., Nobre A. C. Where and when to pay attention: The neural systems for directing attention to spatial locations and to time intervals as revealed by both PET and fMRI // J. Neurosci. 1998. Vol. 18, no. 18. P. 7426–7435. doi: 10.1523/JNEUROSCI.18-18-07426.1998.
  54. D'Esposito M. From cognitive to neural models of working memory // Phil. Trans. R. Soc. B. 2007. Vol. 362, no. 1481. P. 761–772. doi: 10.1098/rstb.2007.2086.
  55. Gazzaley A., Nobre A. C. Top-down modulation: bridging selective attention and working memory // Trends Cogn. Sci. 2012. Vol. 16, no. 2. P. 129–135. doi: 10.1016/j.tics.2011.11.014.
  56. Ivry R. B., Schlerf J. E. Dedicated and intrinsic models of time perception // Trends Cogn. Sci. 2008. Vol. 12, no. 7. P. 273–280. doi: 10.1016/j.tics.2008.04.002.
  57. Alavash M., Tune S., Obleser J. Dynamic large-scale connectivity of intrinsic cortical oscillations supports adaptive listening in challenging conditions // PLoS Biol. 2021. Vol. 19, no. 10. P. e3001410. doi: 10.1371/journal.pbio.3001410.
  58. Liu H., Hu Z., Guo T., Peng D. Speaking words in two languages with one brain: Neural overlap and dissociation // Brain Research. 2010. Vol. 1316. P. 75–82. doi: 10.1016/j.brainres.2009.12.030.
  59. Smets E. M. A., Garssen B., Cull A., De Haes J. C. J. M. Application of the multidimensional fatigue inventory (MFI-20) in cancer patients receiving radiotherapy // British Journal of Cancer. 1996. Vol. 73, no. 2. P. 241–245. doi: 10.1038/bjc.1996.42.
  60. Lee K. A., Hicks G., Nino-Murcia G. Validity and reliability of a scale to assess fatigue // Psychiatry Research. 1991. Vol. 36, no. 3. P. 291–298. doi: 10.1016/0165-1781(91)90027-M.
  61. Sato S. D., Choi J. T. Corticospinal drive is associated with temporal walking adaptation in both healthy young and older adults // Front. Aging Neurosci. 2022. Vol. 14. P. 920475. doi: 10.3389/fnagi.2022.920475.
  62. Hoonakker P., Carayon P., Gurses A. P., Brown R., Khunlertkit A., McGuire K., Walker J. M. Measuring workload of ICU nurses with a questionnaire survey: the NASA Task Load Index (TLX) // IIE Transactions on Healthcare Systems Engineering. 2011. Vol. 1, no. 2. P. 131–143. doi: 10.1080/19488300.2011.609524.
  63. Mouze-Amady M., Raufaste E., Prade H., Meyer J.-P. Fuzzy-TLX: using fuzzy integrals for evaluating human mental workload with NASA-Task Load indeX in laboratory and field studies // Ergonomics. 2013. Vol. 56, no. 5. P. 752–763. doi: 10.1080/00140139.2013.776702.
  64. Said S., Gozdzik M., Roche T. R., Braun J., Rossler J., Kaserer A., Spahn D. R., Nothiger C. B., Tscholl D. W. Validation of the raw National Aeronautics and Space Administration Task Load Index (NASA-TLX) questionnaire to assess perceived workload in patient monitoring tasks: Pooled analysis study using mixed models // J. Med. Internet Res. 2020. Vol. 22, no. 9. P. e19472. doi: 10.2196/19472.
  65. English Vocabulary Level Test [Electronic resource]. Oxford Online English, 2011. Available from: https://www.oxfordonlineenglish.com/english-level-test/vocabulary.
  66. Gentilucci M., Bernardis P., Crisi G., Dalla Volta R. Repetitive transcranial magnetic stimulation of Broca’s area affects verbal responses to gesture observation // Journal of Cognitive Neuroscience. 2006. Vol. 18, no. 7. P. 1059–1074. doi: 10.1162/jocn.2006.18.7.1059.

This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies