[Home ] [Archive]   [ فارسی ]  
:: Main :: About :: Current Issue :: Archive :: Search :: Submit :: Contact ::
Main Menu
Journal Information::
About the Journal
Editorial Board
Aims & Scopes
Journal News
Articles archive::
All Issues
Current Issue
For Authors::
Submission Instruction
Submission Form
Peer review process
Ethical Consideration
For Reviewers::
Reviewers Section
Registration::
Registration Form
Contact us::
Contact Information
Indexing::
open access policy::
::
Search in website

Advanced Search
..
Receive site information
Enter your Email in the following box to receive the site news and information.
..
Registered in

AWT IMAGE

AWT IMAGE
..
:: Volume 12, Issue 4 (Autumn 2023) ::
aumj 2023, 12(4): 485-495 Back to browse issues page
Analyzing the Quality of Objective Structured Clinical Examination in Alborz University of Medical Sciences
Suleiman Ahmadi1 , Amin Habibi2 , Mitra Rahimzadeh3 , Shahla Bahrami * 4
1- Department of medical education, Virtual School of Medical Education, Shahid Beheshti university of Medical sciences, Tehran, Iran.
2- Department of medical education, smart university of Medical sciences, Tehran, Iran
3- Social Determinants of Health Research Center, Biostatistics and Epidemiology Department. Public Health School, Alborz,Iran.
4- Masters student in medical education, Virtual School of Medical Education, Shahid Beheshti university of Medical sciences, Tehran, Iran.
Abstract:   (559 Views)
Introduction: One of the evaluation methods is based on the performance of objective structured clinical examination. Passing this exam is necessary for medical students to graduate, practice medicine and participate in a specialized course. This study is designed to analyze the quality of these tests using psychometric indicators.

Methods: In this cross-sectional descriptive study, the test of three periods of clinical competence, respectively, were analyzed. Average (standard deviation), the cut-off score was (by borderline regression method), rejection rate, R2 determination coefficient, root mean square error to estimate the the cut-off score, difficulty coefficient, neatness coefficient were calculated in individual stations and the whole test.

Findings: 64 medical students along with 26 expert examiners from each station were present in this exam. According to the cut-off score in the 31st exam, all students got a passing grade and we did not fail. The total RMSE was equal to 0.55 and the value of R2 in different stations was obtained from 0.46 to 0.85. The hardest and easiest stations based on the difficulty coefficient were gynecology, social medicine and orthopedics respectively. In the 32nd exam, the rejection rate was one person (0.23%). The total RMSE was 0.57 and the value of R2 in different stations was obtained from 0.38 to 0.87. The most difficult and the easiest stations based on the difficulty coefficient were radilogy, emergency medicine and surgery respectively. In the 33rd exam, all students got a passing grade. Total RMSE was equal to 0.76 and R2 value was obtained in different stations from 0.39 to 0.95. The most difficult and easiest stations based on the difficulty coefficient were internal glands and surgery respectively.

Conclusion: To improve the quality of the OSCE exam, measuring its quality is vital. The use of several psychometric indicators can be an important step in determining the quality of the test. The results obtained during the three test periods indicate that the quality of the test is acceptable in most of the stations and some cases need to be reviewed and improved.
Keywords: Test analysis, Objective Structured Clinical Examination, clinical competency, psychometrics, border Regression
Full-Text [PDF 1020 kb]   (338 Downloads)    
Type of Study: Research | Subject: Special
Received: 2023/01/10 | Accepted: 2023/09/18 | Published: 2023/12/01
References
1. Mlek M, Amico M D, Naseem A, Waddington D, Hamalian A/Nursing Students learning Experiences in Clinical Settings:Stress,Anxiety and Coping/ Ma Thesis/ Canada:Concordia University/2011/
2. Craven R/ Fundamentals of nursing: Human Health and Function/ 4th ed/ Philadelphia: Wolters Kluwer/ 2003/ PP: 137-162, 362-371/
3. Saarikoski M, Kaila P, Lambrinou E, Pérez Cañaveras RM, Tichelaar E, Tomietto M, et al/ Students' experiences of cooperation with nurse teacher during their clinical placements: an empirical study in a Western European context/ Nurse Educ Pract/ 2013 Mar/13(2)/pp:78-82/ [DOI:10.1016/j.nepr.2012.07.013]
4. Mongwe RN, Van der Wall DM/ Students Nurses experiences of the clinical field in the Limpopo province as leraning Field: A Phenomenological study/ PhD Thesis/ University of South Africa/2007/
5. Pap I, Markkanen M, Von B/ Clinical environment as a learning environment:Student nurse perceptions concerning clinical learning experiences/ Nurse Educ today/ May2003/23(4)/ PP:262-268/ [DOI:10.1016/S0260-6917(02)00185-5]
6. Hassani p, Cheraghi F, Yaghmaei F/ self-efficacy and elfregulted learning in clinical performance of nursing students: A qualitative research/ Iranian Jornal of medical education/2008 spr-sum/ 8(1)/PP:33-41/
7. Frankel A/ Nurses' learning styles: promoting better integration of theory into practice/ Nurs Times/ 2009 Jan/105(2)/pp:24-7/
8. Hartigan Rogers JA// Nursing Graduate perception of clinical placement/ International journal of nursing education scholarship 2007;4(2):1-14/ [DOI:10.2202/1548-923X.1276]
9. Chesser-Smyth PA/ The lived experiences of general student nurses on their first clinical placement: A phenomenological study/ Nurse Educ Pract 2005;5(6):320-7/ [DOI:10.1016/j.nepr.2005.04.001]
10. Andrews GJ, Brodie DA, Andrews JP, Hillan E, Gail Thomas B, Wong J, et al/ Professional roles and communications in clinical placements: A qualitative study of nursing students' perceptions and some models for practice/ Int J Nurs Stud 2006;43(7):861-74/ [DOI:10.1016/j.ijnurstu.2005.11.008]
11. Dickson C, Walker J, Bourgeois S/ Facilitating undergraduate nurses clinical practicum: the lived experience of clinical facilitators/ Nurse Educ Today 2006;26(5):416-22/ [DOI:10.1016/j.nedt.2005.11.012]
12. Peyrovi H/ Student nurses experiences of clinical placement/ A Dissertation presented in PhD of nursing/Iran University of Medical Science/ 2005/ [DOI:10.1111/j.1466-7657.2005.00417.x]
13. Ebrahimi H, Sanagoo A, Jouybari L/ Experiences of Nursing Students about stress in clinical setting/Golestan University of Medical Sciences/ 2006/
14. Sharif F, masoumi S/ A qualitatative study of nursing student experiences of clinical practice/ BMC Nursing 2005;4:6/ [DOI:10.1186/1472-6955-4-6]
15. Mortaz Hejri S, Jalili M/ Analyzing the Quality of Objective Structured Clinical Examination in Tehran University of Medical Sciences/ Iran J Med Educ/ 2017;17:50-9/
16. Arnold L/ Assessing professional behavior: yesterday, today, and tomorrow/ Acad Med/ 2002;77(6):502-15/ [DOI:10.1097/00001888-200206000-00006]
17. Aranda S, Yates P/ A National Professional Development Framework for Cancer Nursing (2nd edn)/ Canberra: The National Cancer Nursing Education Project (EdCaN), Cancer Australia/ 2009
18. Tabrizi JS/ Objective Structured Field Examination (OSFE) TT/ IJME [Internet]/ 2012 Mar 1;11(8):976-8/ Available from: http://ijme/mui/ac/ir/article-1-1474-en/html
19. Al-Wardy NM/ Assessment methods in undergraduate medical education/ Sultan Qaboos Univ Med J [Internet]/ 2010/07/19/ 2010 Aug;10(2):203-9/ Available from: https://pubmed/ncbi/nlm/nih/gov/21509230
20. Pell G, Fuller R, Homer M, Roberts T/ How to measure the quality of the OSCE: a review of metrics-AMEE guide no/ 49/ Med Teach/ 2010;32(10):802-11/ [DOI:10.3109/0142159X.2010.507716]
21. Fuller R, Homer M, Pell G/ Longitudinal interrelationships of OSCE station level analyses, quality improvement and overall reliability/ Med Teach/ 2013;35(6):515-7/ [DOI:10.3109/0142159X.2013.775415]
22. Homer M, Pell G, Fuller R, Patterson J. Quantifying error in OSCE standard setting for varying cohort sizes: A resampling approach to measuring assessment quality. Med Teach. 2016; 38(2):181-8. [DOI:10.3109/0142159X.2015.1029898]
23. 23 MortazHejri S, Jalili M, Muijtjens AMM, Van Der Vleuten CPM. Assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination. J Res Med Sci. 2013; 18(10): 887-891.
24. Huang CC, Chan CY, Wu CL, Chen YL, Yang HW, Huang CC, Chen CH, Huang WJ, Lee FY, Lin SJ, Chen JW. Assessment of clinical competence of medical students using the objective structured clinical examination: first 2 years' experience in Taipei Veterans General Hospital. Journal of the Chinese Medical Association. 2010 Nov 1;73(11):589-95. [DOI:10.1016/S1726-4901(10)70128-3]
25. Elabd K, Abdul-Kadir H, Alkhenizan A, Alkhalifa MK. A Comparison of the Checklist Scoring Systems, Global Rating Systems, and Borderline Regression Method for an Objective Structured Clinical Examination for a Small Cohort in a Saudi Medical School. Cureus. 2023 Jun 5;15(6). [DOI:10.7759/cureus.39968]
26. Park SY, Lee SH, Kim MJ, Ji KH, Ryu JH. Comparing the cut score for the borderline group method and borderline regression method with norm-referenced standard setting in an objective structured clinical examination in medical school in Korea. Journal of educational evaluation for health professions. 2021 Sep 27; [DOI:10.3352/jeehp.2021.18.25]
Add your comments about this article
Your username or Email:

CAPTCHA

XML   Persian Abstract   Print

Download citation:
BibTeX | RIS | EndNote | Medlars | ProCite | Reference Manager | RefWorks
Send citation to:
Ahmadi S, Habibi A, Rahimzadeh M, Bahrami S. Analyzing the Quality of Objective Structured Clinical Examination in Alborz University of Medical Sciences. aumj 2023; 12 (4) :485-495
URL: http://aums.abzums.ac.ir/article-1-1651-en.html
Rights and permissions
Creative Commons License This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Volume 12, Issue 4 (Autumn 2023) Back to browse issues page
نشریه دانشگاه علوم پزشکی البرز Alborz University Medical Journal
Persian site map - English site map - Created in 0.06 seconds with 39 queries by YEKTAWEB 4660