Digital educational environment: Effectiveness of adaptive testing of medical students

Cover Page

Cite item

Full Text

Open Access Open Access
Restricted Access Access granted
Restricted Access Subscription Access

Abstract

BACKGROUND: The computer-adaptive approach in testing is becoming more widespread, and research and optimization of algorithms for its work are underway, especially in the pedagogical sphere. According to literature data, adaptive testing has several advantages over traditional linear testing of knowledge, which determined the purpose and objectives of the study.

AIM: To assess the feasibility of using an adaptive approach in digital test control of the knowledge of students majoring in Dentistry, through a comparative analysis of their psycho-emotional state, success of the test task completion, and time spent.

MATERIAL AND METHODS: In this study, we considered the simplest mechanism of the algorithm (pyramid strategy) to ensure the adaptive operation of a computer test. The study included 446 first-year students of the Moscow State Medical University named after A.I. Evdokimov, who were majoring in dentistry (average age 18.76±2.26 years), divided into two groups: control group (n=200), in which linear testing was conducted, and experimental group (n=246), in which adaptive testing was conducted. The testing process is implemented through publicly available electronic resources and platforms.

RESULTS: As the result of the study the absence of statistically significant differences in all parameters (p >0.05), except for time costs (p <0.05), was determined.

CONCLUSIONS: The results of the study emphasized the feasibility of an adaptive approach in digital test control of the knowledge of students majoring in Dentistry.

About the authors

Maria A. Meshcheryakova

A.I. Evdokimov Moscow State University of Medicine and Dentistry

Email: svet.mma@mail.ru
ORCID iD: 0000-0003-0016-1667

MD, Dr. Sci. (Ped.), Cand. Sci. (Med.), Professor

Russian Federation, Moscow

Ramaz Sh. Gvetadze

A.I. Evdokimov Moscow State University of Medicine and Dentistry

Email: gvetadze-rs@msmsu.ru
ORCID iD: 0000-0003-0508-7072

Corr. Member RAS, Dr. Sci. (Med.), Professor

Russian Federation, Moscow

Yaser N. Kharakh

A.I. Evdokimov Moscow State University of Medicine and Dentistry

Author for correspondence.
Email: c.kKharakh@gmail.com
ORCID iD: 0000-0001-7181-8211
SPIN-code: 7217-1160

MD, Cand. Sci. (Med.)

Russian Federation, Moscow

Veronika M. Karpova

A.I. Evdokimov Moscow State University of Medicine and Dentistry

Email: karpovavm82@gmail.com
ORCID iD: 0000-0003-1003-6667
SPIN-code: 5404-1770

Cand. Sci. (Med.), Associate Professor

Russian Federation, Moscow

Marina V. Timoshchenko

A.I. Evdokimov Moscow State University of Medicine and Dentistry

Email: 89162628590@mail.ru
ORCID iD: 0000-0002-6949-9351
SPIN-code: 7281-6560

Cand. Sci. (Med.)

Russian Federation, Moscow

Mariam S. Galstyan

A.I. Evdokimov Moscow State University of Medicine and Dentistry

Email: galstyan_mariam@mail.ru
ORCID iD: 0000-0002-3372-5775
SPIN-code: 3814-7044
Russian Federation, Moscow

Sergey D. Arutyunov

A.I. Evdokimov Moscow State University of Medicine and Dentistry

Email: sd.arutyunov@mail.ru
ORCID iD: 0000-0001-6512-8724
SPIN-code: 1052-4131

Dr. Sci. (Med.), Professor

Russian Federation, Moscow

References

  1. Mason BJ, Patry M, Bernstein DJ. An Examination of the Equivalence between Non-Adaptive Computer-Based and Traditional Testing. J Educ Comput Res. 2001;24(1):29–39. doi: 10.2190/9EPM-B14R-XQWT-WVNL
  2. Monaghan MS, Cain JJ, Malone PM, et al. Educational technology use among US colleges and schools of pharmacy. Am J Pharm Educ. 2011;75(5):87. doi: 10.5688/ajpe75587
  3. Aybek EC, Demirtasli RN. Computerized adaptive test (CAT) applications and item response theory models for polytomous items. Int J Res Method Educ. 2017;3(2):475–487. doi: 10.21890/ijres.327907
  4. Delgado-Gómez D, Laria JC, Ruiz-Hernández D. Computerized adaptive test and decision trees: A unifying approach. Expert Syst Appl. 2018;117:358–366. doi: 10.1016/j.eswa.2018.09.052
  5. Morphew JW, Mestre JP, Kang HA, et al. Using computer adaptive testing to assess physics proficiency and improve exam performance in an introductory physics course. Phys Rev Phys Educ Res. 2018;14(2):020110. doi: 10.1103/PhysRevPhysEducRes.14.020110
  6. Van Groen MM, Eggen TJHM, Veldkamp BP. Multidimensional Computerized Adaptive Testing for Classifying Examinees With Within-Dimensionality. Appl Psychol Meas. 2016;40(6):387–404. doi: 10.1177/0146621616648931
  7. Lord FM. The self-scoring flexilevel test. J Educ Meas. 1971;8(3):147–151. doi: 10.1111/j.1745-3984.1971.tb00918.x
  8. Henning G. A guide to language testing: development, evaluation, research. Cambridge, Mass.: Newbury House; 1987. 198 p.
  9. Lewis C, Sheehan K. Using Bayesian decision theory to design a computerized mastery test. Appl Psychol Meas. 1990;14(4):367–386. doi: 10.1177/014662169001400404
  10. Reckase MD. An interactive computer program for tailored testing based on the oneparameter logistic model. Behav Res Methods Instrum. 1974;6(2):208–212. doi: 10.3758/BF03200330
  11. Martin AJ, Lazendic G. Computer Adaptive Testing: Implications for Students’ Achievement, Motivation, Engagement, and Subjective Test Experience. J Educ Psychol. 2018;110(1):27–45. doi: 10.1037/edu0000205
  12. Kalender İ. Computerized adaptive testing for student selection to higher education. Yükseköğretim Dergisi. 2012;2(1):13–19. doi: 10.2399/yod.12.004
  13. Mizumoto A, Sasao Y, Webb SA. Developing and Evaluating A Computerized Adaptive Testing Version of the Word Part Levels Test. Lang Test. 2017;36(1):101–123. doi: 10.1177/0265532217725776
  14. Weiss DJ. Adaptive testing by computer. J Consult Clin Psychol. 1985;53(6):774–789. doi: 10.1037/0022-006X.53.6.774
  15. Malygin АА. Strategies and algorithms of realization of adaptive technologies based on educational measurements. University Bulletin. 2013;(15):393–401. (In Russ).
  16. Abouserie R. Self-esteem and achievement motivation as determinants of students’ approaches to studying. Stud High Educ. 1995;20(1):19–26. doi: 10.1080/03075079512331381770
  17. Cassady JC, Johnson RE. Cognitive test anxiety and academic performance. Contemp Educ Psychol. 2002;27(2):270–295. doi: 10.1006/ceps.2001.1094
  18. Moreira de Sousa J, Moreira CA, Telles-Correia D. Anxiety, Depression and Academic Performance: A Study Amongst Portuguese Medical Students Versus Non-Medical Students. Acta Med Port. 2018;31(9):454–462. doi: 10.20344/amp.9996
  19. Pascoe MC, Hetrick SE, Parker AG. The impact of stress on students in secondary school and higher education. Int J Adolesc Youth. 2020;25(1):104–112. doi: 10.1080/02673843.2019.1596823
  20. Mealey DL, Host TR. Coping with test anxiety. Coll. 1992;40(4):147–150. doi: 10.1080/87567555.1992.10532238
  21. Putwain DW, Woods KA, Symes W. Personal and situational predictors of test anxiety of students in post-compulsory education. Br J Educ Psychol. 2010;80(1):137–160. doi: 10.1348/000709909X466082
  22. Trifoni A, Shahini M. How does exam anxiety affect the performance of university students? Mediterr J Soc Sci. 2011;2(2):93–93.
  23. Onyeizugbo EU. Self-efficacy, gender and trait anxiety as moderators of test anxiety. Electron J Res Educ Psychol. 2010;8(1):299–312.
  24. Ling G, Attali Y, Finn B, Stone EA. Is a Computerized Adaptive Test More Motivating Than a Fixed-Item Test? Appl Psychol Meas. 2017;41(7):495–511. doi: 10.1177/0146621617707556
  25. Tonidandel S, Quiñones MA, Adams AA. Computer-adaptive testing: the impact of test characteristics on perceived performance and test takers’ reactions. J Appl Psychol. 2002;87(2):320–332. doi: 10.1037/0021-9010.87.2.320
  26. Frey A, Hartig J, Moosbrugger H. Effekte des adaptiven Testens auf die Motivation zur Testbearbeitung am Beispiel des Frankfurter Adaptiven Konzentrationsleistungs-Tests. Diagnostica. 2009;55(1):20–28. doi: 10.1026/0012-1924.55.1.20
  27. Benke C, Autenrieth LK, Asselmann E, Pané-Farré CA. Lockdown, quarantine measures, and social distancing: Associations with depression, anxiety and distress at the beginning of the COVID-19 pandemic among adults from Germany. Psychiatry Res. 2020;293:113462. doi: 10.1016/j.psychres.2020.113462
  28. González-Sanguino C, Ausín B, Castellanos MÁ, et al. Mental health consequences during the initial stage of the 2020 Coronavirus pandemic (COVID-19) in Spain. Brain Behav Immun. 2020;87:172–176. doi: 10.1016/j.bbi.2020.05.040
  29. Hill MR, Goicochea S, Merlo LJ. In their own words: stressors facing medical students in the millennial generation. Med Educ Online. 2018;23(1):1530558. doi: 10.1080/10872981.2018.1530558
  30. Sa B, Ojeh N, Majumder MAA, et al. The Relationship Between Self-Esteem, Emotional Intelligence, and Empathy Among Students From Six Health Professional Programs. Teach Learn Med. 2019;31(5):536–543. doi: 10.1080/10401334.2019.1607741
  31. Gambin M, Sękowski M, Woźniak-Prus M, et al. Generalized anxiety and depressive symptoms in various age groups during the COVID-19 lockdown in Poland. Specific predictors and differences in symptoms severity. Compr Psychiatry. 2021;105:152222. doi: 10.1016/j.comppsych.2020.152222

Copyright (c) 2022 Meshcheryakova M.A., Gvetadze R.S., Kharakh Y.N., Karpova V.M., Timoshchenko M.V., Galstyan M.S., Arutyunov S.D.

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
 


This website uses cookies

You consent to our cookies if you continue to use our website.

About Cookies