Improving the Russian-language Wikipedia articles on medicines using new knowledge Cochrane
- Authors: Potapov AS1, Alexandrova EG1, Yudina EV2,3, Ziganshina LE2,4
-
Affiliations:
- Kazan Federal University
- Russian Medical Academy for Continuing Professional Education (RMANPO)
- City Children's Hospital № 1
- Kazan State Medical University
- Issue: Vol 102, No 4 (2021)
- Pages: 459-473
- Section: Theoretical and clinical medicine
- URL: https://journals.rcsi.science/kazanmedj/article/view/63282
- DOI: https://doi.org/10.17816/KMJ2021-459
- ID: 63282
Cite item
Abstract
Aim. To evaluate the effectiveness of the Cochrane Russia Initiative to improve the articles of the Russian-language Wikipedia by including information from Cochrane Systematic Reviews (CSR) to ensure the accuracy and impartiality of their content as an information basis for the quality use of medicines by doctors and the public.
Methods. Wikipedia articles on selected drugs were improved by introducing evidence from Cochrane Systematic Reviews — “Cochrenized”. A parallel open-label non-randomized controlled intervention study was conducted. We assigned 2 groups of drugs and Wikipedia articles about them: the intervention group (“Cochrenization”) and the control group (36 articles each). Control group articles were not edited. The change in the number of visits to Wikipedia pages for the year (2018–2019) was measured, the statistical significance of the differences was assessed by using the Wilcoxon signed-rank test.
Results. We edited 36 Wikipedia articles, including 13 articles on migraine treatment, 9 diabetes mellitus, 14 pain and inflammation articles. These articles constituted the intervention group. The control group consisted of articles on cardiovascular (11), gastrointestinal (14) and dermatological agents (11). We used the Cochrane Russia Initiative dashboard on Wikipedia to compare the number of article views before and after the intervention and Cochrane analytics on demand for translations of Cochrane systematic reviews summaries. After “Cochrenization”, the number of Wikipedia article views (2018–2019) increased in total/average article views for treatments: migraines by 18%/47%, pain and inflammation — 16%/43%, diabetes mellitus — 18%/0%. Analysis of Cochrane reports showed an increase in the number of views of Cochrane systematic reviews summaries on the Cochrane.org website in general by 9 times and from Russian-speaking browsers by 11 times. Improvement of medicine-related articles of the Russian-language Wikipedia by the introduction of information from Cochrane systematic reviews was accompanied by an increase in their demand in terms of the number of views in general by 34%, with a similar increase in control (without intervention) (p-value of the experimental group — 0.002, control — 0.000). The Wikipedia articles on medicines, which belonged to the Russian Vital and Essential Drugs List or the World Health Organization Model List of Essential Medicines, got more views.
Conclusion. The role of confounding factors justifies the feasibility of developing a methodology for studying the usefulness of improving Wikipedia articles, different from controlled trial research methodology; further inclusion of Cochrane knowledge into Wikipedia is needed.
Keywords
Full Text
##article.viewOnOriginalSite##About the authors
A S Potapov
Kazan Federal University
Author for correspondence.
Email: Potapov0770@gmail.com
Russian Federation, Kazan, Russia
E G Alexandrova
Kazan Federal University
Email: Potapov0770@gmail.com
Russian Federation, Kazan, Russia
E V Yudina
Russian Medical Academy for Continuing Professional Education (RMANPO); City Children's Hospital № 1
Email: Potapov0770@gmail.com
Russian Federation, Moscow, Russia; Kazan, Russia
L E Ziganshina
Russian Medical Academy for Continuing Professional Education (RMANPO); Kazan State Medical University
Email: Potapov0770@gmail.com
Russian Federation, Moscow, Russia; Kazan, Russia
References
- Cochrane: About us. Cochrane.org. https://www.cochrane.org/about-us (access date: 25.02.2020).
- Cochrane. Cochrane and Wikipedia: working together to improve access to health evidence. Cochrane.org. https://www.cochrane.org/news/cochrane-and-wikipedia-working-together-improve-access-health-evidence (access date: 10.03.2020).
- Fenley S. Navigation and visualisation tools usage in large internet and multimedia resources. In: Practical applications of intelligent systems. Berlin, Heidelberg: Springer. 2011; 97–104. doi: 10.1007/978-3-642-25658-5_12.
- Gavali M.Y., Khismatrao D.S., Gavali Y.V., Patil K.B. Smartphone, the new learning aid amongst medical students. J. Clin. Diagn. Res.: JCDR. 2017; 11 (5): JC05. doi: 10.7860/JCDR/2017/20948.9826.
- Lee K., Hoti K., Hughes J.D., Emmerton L. Dr Google is here to stay but health care professionals are still valued: an analysis of health care consumers’ internet navigation support preferences. J. Med. Intern. Res. 2017; 19 (6): e210. doi: 10.2196/jmir.7489.
- Sandars J. Technology and the delivery of the curriculum of the future: opportunities and challenges. Med. Teacher. 2012; 34 (7): 534–538. doi: 10.3109/0142159X.2012.671560.
- Del Fiol G., Workman T.E., Gorman P.N. Clinical questions raised by clinicians at the point of care: a systematic review. JAMA Intern. Med. 2014; 174 (5): 710–718. doi: 10.1001/jamainternmed.2014.368.
- Ahamad A., Wallner P., Salenius S., Ross R., Fernandez E. Information needs expressed during patient-oriented oncology consultations: quantity, variation, and barriers. J. Cancer Education. 2019; 34 (3): 488–497. doi: 10.1007/s13187-018-1329-5.
- Lim B.T., Butow P., Mills J., Miller A., Goldstein D. Information needs of the Chinese community affected by cancer: A systematic review. Psycho‐oncology. 2017; 26 (10): 1433–1443. doi: 10.1002/pon.4347.
- Sullivan S. Google now handles at least 2 trillion searches per year. Search Engine Land 24. https://searchengineland.com/google-now-handles-2-999-trillion-searches-per-year-250247 (access date: 27.02.2020).
- Ramaswami P. A remedy for your health-related questions: health info in the knowledge graph. Google Official Blog. https://blog.google/products/search/health-info-knowledge-graph (access date: 15.03.2020).
- Richards L. Why Wikipedia is still visible across Google’s SERPs in 2018. Search Engine Watch. https://www.searchenginewatch.com/2018/11/13/why-wikipedia-is-still-visible-across-googles-serps-in-2018 (access date: 21.10.2020).
- Laurent M.R., Vickers T.J. Seeking health information online: does Wikipedia matter? J. Am. Med. Inform. Assoc. 2009; 16 (4): 471–479. doi: 10.1197/jamia.M3059.
- Wikipedia. Wikipedia: About. Wikipedia.org. https://en.wikipedia.org/wiki/Wikipedia:About (access date: 13.03.2020).
- The top sites on the web. Alexa. http://www.alexa.com/topsites (access date: 15.04.2020).
- Heilman J.M., Kemmann E., Bonert M., Chatterjee A., Ragar B., Beards G.M., Iberri D.J., Harvey M., Thomas B., Stomp W., Martone M.F. Wikipedia: a key tool for global public health promotion. J. Med. Intern. Res. 2011; 13 (1): e14. doi: 10.2196/jmir.1589.
- Masukume G., Kipersztok L., Das D., Shafee T., Laurent M.R., Heilman J.M. Medical journals and Wikipedia: a global health matter. Lancet Global Health. 2016; 4 (11): e791. doi: 10.1016/S2214-109X(16)30254-6.
- Shafee T., Masukume G., Kipersztok L., Das D., Häggström M., Heilman J. Evolution of Wikipedia’s medical content: past, present and future. J. Epidemiol. Comm. Health. 2017; 71 (11): 1122–1129. doi: 10.1136/jech-2016-208601.
- Allahwala U.K., Nadkarni A., Sebaratnam D.F. Wikipedia use amongst medical students — new insights into the digital revolution. Med. Teacher. 2013; 35 (4): 337. doi: 10.3109/0142159X.2012.737064.
- Kingsley K., Galbraith G.M., Herring M., Stowers E., Stewart T., Kingsley K.V. Why not just Google it? An assessment of information literacy skills in a biomedical science curriculum. BMC Med. Education. 2011; 11 (1): 1–8. doi: 10.1186/1472-6920-11-17.
- Azzam A., Bresler D., Leon A., Maggio L., Whitaker E., Heilman J., Orlowitz J., Swisher V., Rasberry L., Otoide K., Trotter F. Why medical schools should embrace Wikipedia: final-year medical student contributions to Wikipedia articles for academic credit at one school. Acad. Med. 2017; 92 (2): 194. doi: 10.1097/ACM.0000000000001381.
- Purdy E., Thoma B., Bednarczyk J., Migneault D., Sherbino J. The use of free online educational resources by Canadian emergency medicine residents and program directors. Canadian J. Emerg. Med. 2015; 17 (2): 101–106. doi: 10.1017/cem.2014.73.
- Apollonio D.E., Broyde K., Azzam A., De Guia M., Heilman J., Brock T. Pharmacy students can improve access to quality medicines information by editing Wikipedia articles. BMC Med. Education. 2018; 18 (1): 1–8. doi: 10.1186/s12909-018-1375-z.
- Haigh C.A. Wikipedia as an evidence source for nursing and healthcare students. Nurse Education Today. 2011; 31 (2): 135–139. doi: 10.1016/j.nedt.2010.05.004.
- Meek J. Is Wikipedia suitable as a learning resource for nursing and healthcare students? HIV Nurs. 2016; 16: 65–66.
- Heilman J.M., West A.G. Wikipedia and medicine: quantifying readership, editors, and the significance of natural language. J. Med. Intern. Res. 2015; 17 (3): e62. doi: 10.2196/jmir.4069.
- Egle J.P., Smeenge D.M., Kassem K.M., Mittal V.K. The Internet School of Medicine: use of electronic resources by medical trainees and the reliability of those resources. J. Surg. Education. 2015; 72 (2): 316–320. doi: 10.1016/j.jsurg.2014.08.005.
- Metcalfe D., Powell J. Should doctors spurn Wikipedia? J. Royal Soc. Med. 2011; 104 (12): 488–489. doi: 10.1258/jrsm.2011.110227.
- Jemielniak D. Common knowledge? An ethnography of Wikipedia. Stanford University Press. 2014; 312 p. doi: 10.11126/stanford/9780804789448.001.0001.
- Shachaf P. The paradox of expertise: is the Wikipedia Reference Desk as good as your library? J. of Documentation. 2009; 65 (6): 977–996. doi: 10.1108/00220410910998951.
- Frambach J.M., Driessen E.W., Chan L.C., van der Vleuten C.P. Rethinking the globalisation of problem‐based learning: how culture challenges self‐directed learning. Med. Education. 2012; 46 (8): 738–747. doi: 10.1111/j.1365-2923.2012.04290.x.
- Callis K.L., Christ L.R., Resasco J., Armitage D.W., Ash J.D., Caughlin T.T., Clemmensen S.F., Copeland S.M., Fullman T.J., Lynch R.L., Olson C. Improving Wikipedia: educational opportunity and professional responsibility. Trends in Ecology & Evolution. 2009; 24 (4): 177–179. doi: 10.1016/j.tree.2009.01.003.
- Bonfill X., Iberoamericano C.C. The Cochrane Collaboration turns 20. Med. Clin. 2014; 143 (5): 210–215. doi: 10.1016/j.medcli.2014.02.003.
- Franco J.V., Arancibia M., Simancas-Racines D., Madrid E. Syntheses of biomedical information: narrative reviews, systematic reviews and emerging formats. Medwave. 2018; 18 (07): е7354. doi: 10.5867/medwave.2018.07.7354.
- Cochrane Library. About the Cochrane Database of Systematic Reviews. https://www.cochranelibrary.com/cdsr/about-cdsr (access date: 23.07.2020).
- Chapman S. What are Cochrane reviews? Cochrane UK. http://www.evidentlycochrane.net/what-are-cochrane-reviews/ (access date: 07.06.2020).
- Wikipedia. “Foundations” white paper. Wikimedia. Meta-wiki. https://meta.wikimedia.org/wiki/Research:2030 (access date: 20.08.2020).
- Wikipedia. “Knowledge integrity” white paper. Wikimedia. Meta-wiki. https://meta.wikimedia.org/wiki/Research:2030 (access date: 20.08.2019).
- Wikipedia. “Knowledge gaps” white paper. Wikimedia. Meta-wiki. https://meta.wikimedia.org/wiki/Research:2030 (access date: 20.08.2020).
- Jemielniak D., Masukume G., Wilamowski M. The most influential medical journals according to Wikipedia: quantitative analysis. J. Med. Intern. Res. 2019; 21 (1): e11429. doi: 10.2196/11429.
- Yang J., Ward J., Gharavi E., Dawson J., Alvarado R. Bi-directional relevance matching between medical corpora. In: 2019 Systems and Information Engineering Design Symposium (SIEDS). IEEE. 2019; 1–6. doi: 10.1109/SIEDS.2019.8735639.
- Joorabchi A., Doherty C., Dawson J. “WP2Cochrane”, a tool linking Wikipedia to the Cochrane Library: Results of a bibliometric analysis evaluating article quality and importance. Health Inform. J. 2020; 26 (3): 1881–1897. doi: 10.1177/1460458219892711.
- Cochrane community. Strategy to 2020. https://community.cochrane.org/organizational-info/resources/strategy-2020 (access date: 26.08.2020).
- The Order of the Government of the RF No. 2738-r, issued at December 10 2018 “List of vital and essential medicines for medical use for 2019”. http://docs.cntd.ru/document/551876844 (access date: 21.05.2020). (In Russ.)
- World Health Organization. World Health Organization model list of essential medicines: 21st list 2019. Geneva: World Health Organization. 2019; 60 p.
- Pharmaceutical market of Russia. October 2018. DSM grupp. https://dsm.ru/upload/iblock/cda/cdaff008612b2ae0fb4d02121da0f6e5.pdf (access date: 24.05.2020). (In Russ.)
- Bol'shoy spravochnik lekarstvennykh sredstv. (A large reference book of medicines.) Ed. by L.E. Ziganshina, V.K. Lepakhin, V.I. Petrov, R.U. Khabriev. M.: GEOTAR-Media. 2012; 3344 р. (In Russ.)
- Wikipedia Pageviews analysis. Wikipedia Pageviews. www.tools.wmflabs.org/pageviews (access date: 12.02.2019).
- Order of the Government of the RF No. 2406-r, issued at October 12 2019 “List of vital and essential medicines for medical use for 2020”. http://docs.cntd.ru/document/551876844 (access date: 22.05.2020). (In Russ.)
- Zdravookhranenie v Rossii 2019. Statisticheskiy sbornik. (Healthcare in Russia 2019. Statistical compilation.) Ed. by I.N. Shapoval, S.Y. Nikitinа, L.I. Ageeva. M.: Rosstat. 2019; 170 р. (In Russ.)
- Research: trends in the Russian pharmaceutical market. Adindex.ru. https://dsm.ru/upload/iblock/cda/cdaff008612b2ae0fb4d02121da0f6e5.pdf (access date: 24.02.2020). (In Russ.)
- Ziganshina L.E., Niyazov R.R. Unethical drug promotion by pharmaceutical industry as the main barrier to the rational use of medicines. Kazan Medical Journal. 2013; 94 (2): 240–244. (In Russ.) doi: 10.17816/KMJ1596.
- Othman N., Vitry A.I., Roughead E.E. Medicines information in medical journal advertising in Australia, Malaysia and the United States: A comparative cross-sectional study. Southern Med. Rev. 2010; 3 (1): 11–18. PMID: 23093878.
- Instructions for the use of the medicinal product for specialists. Approved by the Ministry of Health of the Republic of Belarus, order of December 10, 2012, No. 1444. Vidal — a reference book of medicines. https://www.vidal.by/poisk_preparatov/airtal.html (access date: 19.05.2020). (In Russ.)
- Giles J. Internet encyclopaedias go head to head. Nature. 2005; 438: 900–901. doi: 10.1038/438900a.