Digital educational environment: Effectiveness of adaptive testing of medical students
- Authors: Meshcheryakova M.A.1, Gvetadze R.S.1, Kharakh Y.N.1, Karpova V.M.1, Timoshchenko M.V.1, Galstyan M.S.1, Arutyunov S.D.1
-
Affiliations:
- A.I. Evdokimov Moscow State University of Medicine and Dentistry
- Issue: Vol 26, No 5 (2022)
- Pages: 421-429
- Section: Digital Dentistry
- URL: https://journals.rcsi.science/1728-2802/article/view/232567
- DOI: https://doi.org/10.17816/dent110954
- ID: 232567
Cite item
Abstract
BACKGROUND: The computer-adaptive approach in testing is becoming more widespread, and research and optimization of algorithms for its work are underway, especially in the pedagogical sphere. According to literature data, adaptive testing has several advantages over traditional linear testing of knowledge, which determined the purpose and objectives of the study.
AIM: To assess the feasibility of using an adaptive approach in digital test control of the knowledge of students majoring in Dentistry, through a comparative analysis of their psycho-emotional state, success of the test task completion, and time spent.
MATERIAL AND METHODS: In this study, we considered the simplest mechanism of the algorithm (pyramid strategy) to ensure the adaptive operation of a computer test. The study included 446 first-year students of the Moscow State Medical University named after A.I. Evdokimov, who were majoring in dentistry (average age 18.76±2.26 years), divided into two groups: control group (n=200), in which linear testing was conducted, and experimental group (n=246), in which adaptive testing was conducted. The testing process is implemented through publicly available electronic resources and platforms.
RESULTS: As the result of the study the absence of statistically significant differences in all parameters (p >0.05), except for time costs (p <0.05), was determined.
CONCLUSIONS: The results of the study emphasized the feasibility of an adaptive approach in digital test control of the knowledge of students majoring in Dentistry.
Full Text
##article.viewOnOriginalSite##About the authors
Maria A. Meshcheryakova
A.I. Evdokimov Moscow State University of Medicine and Dentistry
Email: svet.mma@mail.ru
ORCID iD: 0000-0003-0016-1667
MD, Dr. Sci. (Ped.), Cand. Sci. (Med.), Professor
Russian Federation, MoscowRamaz Sh. Gvetadze
A.I. Evdokimov Moscow State University of Medicine and Dentistry
Email: gvetadze-rs@msmsu.ru
ORCID iD: 0000-0003-0508-7072
Corr. Member RAS, Dr. Sci. (Med.), Professor
Russian Federation, MoscowYaser N. Kharakh
A.I. Evdokimov Moscow State University of Medicine and Dentistry
Author for correspondence.
Email: c.kKharakh@gmail.com
ORCID iD: 0000-0001-7181-8211
SPIN-code: 7217-1160
MD, Cand. Sci. (Med.)
Russian Federation, MoscowVeronika M. Karpova
A.I. Evdokimov Moscow State University of Medicine and Dentistry
Email: karpovavm82@gmail.com
ORCID iD: 0000-0003-1003-6667
SPIN-code: 5404-1770
Cand. Sci. (Med.), Associate Professor
Russian Federation, MoscowMarina V. Timoshchenko
A.I. Evdokimov Moscow State University of Medicine and Dentistry
Email: 89162628590@mail.ru
ORCID iD: 0000-0002-6949-9351
SPIN-code: 7281-6560
Cand. Sci. (Med.)
Russian Federation, MoscowMariam S. Galstyan
A.I. Evdokimov Moscow State University of Medicine and Dentistry
Email: galstyan_mariam@mail.ru
ORCID iD: 0000-0002-3372-5775
SPIN-code: 3814-7044
Russian Federation, Moscow
Sergey D. Arutyunov
A.I. Evdokimov Moscow State University of Medicine and Dentistry
Email: sd.arutyunov@mail.ru
ORCID iD: 0000-0001-6512-8724
SPIN-code: 1052-4131
Dr. Sci. (Med.), Professor
Russian Federation, MoscowReferences
- Mason BJ, Patry M, Bernstein DJ. An Examination of the Equivalence between Non-Adaptive Computer-Based and Traditional Testing. J Educ Comput Res. 2001;24(1):29–39. doi: 10.2190/9EPM-B14R-XQWT-WVNL
- Monaghan MS, Cain JJ, Malone PM, et al. Educational technology use among US colleges and schools of pharmacy. Am J Pharm Educ. 2011;75(5):87. doi: 10.5688/ajpe75587
- Aybek EC, Demirtasli RN. Computerized adaptive test (CAT) applications and item response theory models for polytomous items. Int J Res Method Educ. 2017;3(2):475–487. doi: 10.21890/ijres.327907
- Delgado-Gómez D, Laria JC, Ruiz-Hernández D. Computerized adaptive test and decision trees: A unifying approach. Expert Syst Appl. 2018;117:358–366. doi: 10.1016/j.eswa.2018.09.052
- Morphew JW, Mestre JP, Kang HA, et al. Using computer adaptive testing to assess physics proficiency and improve exam performance in an introductory physics course. Phys Rev Phys Educ Res. 2018;14(2):020110. doi: 10.1103/PhysRevPhysEducRes.14.020110
- Van Groen MM, Eggen TJHM, Veldkamp BP. Multidimensional Computerized Adaptive Testing for Classifying Examinees With Within-Dimensionality. Appl Psychol Meas. 2016;40(6):387–404. doi: 10.1177/0146621616648931
- Lord FM. The self-scoring flexilevel test. J Educ Meas. 1971;8(3):147–151. doi: 10.1111/j.1745-3984.1971.tb00918.x
- Henning G. A guide to language testing: development, evaluation, research. Cambridge, Mass.: Newbury House; 1987. 198 p.
- Lewis C, Sheehan K. Using Bayesian decision theory to design a computerized mastery test. Appl Psychol Meas. 1990;14(4):367–386. doi: 10.1177/014662169001400404
- Reckase MD. An interactive computer program for tailored testing based on the oneparameter logistic model. Behav Res Methods Instrum. 1974;6(2):208–212. doi: 10.3758/BF03200330
- Martin AJ, Lazendic G. Computer Adaptive Testing: Implications for Students’ Achievement, Motivation, Engagement, and Subjective Test Experience. J Educ Psychol. 2018;110(1):27–45. doi: 10.1037/edu0000205
- Kalender İ. Computerized adaptive testing for student selection to higher education. Yükseköğretim Dergisi. 2012;2(1):13–19. doi: 10.2399/yod.12.004
- Mizumoto A, Sasao Y, Webb SA. Developing and Evaluating A Computerized Adaptive Testing Version of the Word Part Levels Test. Lang Test. 2017;36(1):101–123. doi: 10.1177/0265532217725776
- Weiss DJ. Adaptive testing by computer. J Consult Clin Psychol. 1985;53(6):774–789. doi: 10.1037/0022-006X.53.6.774
- Malygin АА. Strategies and algorithms of realization of adaptive technologies based on educational measurements. University Bulletin. 2013;(15):393–401. (In Russ).
- Abouserie R. Self-esteem and achievement motivation as determinants of students’ approaches to studying. Stud High Educ. 1995;20(1):19–26. doi: 10.1080/03075079512331381770
- Cassady JC, Johnson RE. Cognitive test anxiety and academic performance. Contemp Educ Psychol. 2002;27(2):270–295. doi: 10.1006/ceps.2001.1094
- Moreira de Sousa J, Moreira CA, Telles-Correia D. Anxiety, Depression and Academic Performance: A Study Amongst Portuguese Medical Students Versus Non-Medical Students. Acta Med Port. 2018;31(9):454–462. doi: 10.20344/amp.9996
- Pascoe MC, Hetrick SE, Parker AG. The impact of stress on students in secondary school and higher education. Int J Adolesc Youth. 2020;25(1):104–112. doi: 10.1080/02673843.2019.1596823
- Mealey DL, Host TR. Coping with test anxiety. Coll. 1992;40(4):147–150. doi: 10.1080/87567555.1992.10532238
- Putwain DW, Woods KA, Symes W. Personal and situational predictors of test anxiety of students in post-compulsory education. Br J Educ Psychol. 2010;80(1):137–160. doi: 10.1348/000709909X466082
- Trifoni A, Shahini M. How does exam anxiety affect the performance of university students? Mediterr J Soc Sci. 2011;2(2):93–93.
- Onyeizugbo EU. Self-efficacy, gender and trait anxiety as moderators of test anxiety. Electron J Res Educ Psychol. 2010;8(1):299–312.
- Ling G, Attali Y, Finn B, Stone EA. Is a Computerized Adaptive Test More Motivating Than a Fixed-Item Test? Appl Psychol Meas. 2017;41(7):495–511. doi: 10.1177/0146621617707556
- Tonidandel S, Quiñones MA, Adams AA. Computer-adaptive testing: the impact of test characteristics on perceived performance and test takers’ reactions. J Appl Psychol. 2002;87(2):320–332. doi: 10.1037/0021-9010.87.2.320
- Frey A, Hartig J, Moosbrugger H. Effekte des adaptiven Testens auf die Motivation zur Testbearbeitung am Beispiel des Frankfurter Adaptiven Konzentrationsleistungs-Tests. Diagnostica. 2009;55(1):20–28. doi: 10.1026/0012-1924.55.1.20
- Benke C, Autenrieth LK, Asselmann E, Pané-Farré CA. Lockdown, quarantine measures, and social distancing: Associations with depression, anxiety and distress at the beginning of the COVID-19 pandemic among adults from Germany. Psychiatry Res. 2020;293:113462. doi: 10.1016/j.psychres.2020.113462
- González-Sanguino C, Ausín B, Castellanos MÁ, et al. Mental health consequences during the initial stage of the 2020 Coronavirus pandemic (COVID-19) in Spain. Brain Behav Immun. 2020;87:172–176. doi: 10.1016/j.bbi.2020.05.040
- Hill MR, Goicochea S, Merlo LJ. In their own words: stressors facing medical students in the millennial generation. Med Educ Online. 2018;23(1):1530558. doi: 10.1080/10872981.2018.1530558
- Sa B, Ojeh N, Majumder MAA, et al. The Relationship Between Self-Esteem, Emotional Intelligence, and Empathy Among Students From Six Health Professional Programs. Teach Learn Med. 2019;31(5):536–543. doi: 10.1080/10401334.2019.1607741
- Gambin M, Sękowski M, Woźniak-Prus M, et al. Generalized anxiety and depressive symptoms in various age groups during the COVID-19 lockdown in Poland. Specific predictors and differences in symptoms severity. Compr Psychiatry. 2021;105:152222. doi: 10.1016/j.comppsych.2020.152222