Does practice make perfect? Variations in OITE performance based on practice question exposure and proficiency.
DOI:
https://doi.org/10.55576/job.v3i3.21Keywords:
OITE, orthopaedic in-training examination, practice question, question bankAbstract
Background: The Orthopedic In-Training Examination (OITE) is used to assess the progression of knowledge during residency. While a large body of research has established that performance on the United States Medical Licensing Exam (USMLE) Step 1 is correlated with OITE performance, research into specific preparation strategies is scarce.
Objective: To prospectively evaluate whether volume and performance on practice questions relates to OITE performance.
Design: Number of practice questions and performance on practice questions of 23 orthopaedic residents at a single institution were tracked for a single academic year. Case load data was collected prospectively from the program director and residents. USMLE Step 1 and 2 and prior OITE scores were gathered retrospectively. The data was evaluated using univariate and multivariate regression analysis.
Setting: This research was conducted at a single institution over the course of one year.
Participants: Twenty-three orthopaedic residents participated over the course of one year.
Main Outcome Measurements: OITE raw score.
Results: Multivariate regression revealed the following variables to have a relationship with raw OITE score: year in training (PGY) (b = 7.112, p < 0.001), percent of questions correct (b = 0.990, p < 0.001) and Step 1 score (b = 0.624, p = 0.002). Multivariate regression for PGY OITE percentile found only mean Step 1 and 2 combined score to be predictive (b = 1.271, p = 0.001).
Conclusion: This prospective study showed that number of practice questions performed in the academic year prior to the annual OITE is not correlated with higher OITE performance, whereas percent of practice questions correct is. PGY was most strongly correlated with OITE performance.
Level of Evidence: Level II Prospective Cohort
Key Words: OITE, orthopaedic in-training examination, practice question, question bank.
Funding: This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.
References
Mankin HJ. The orthopaedic in-training examination (OITE). Clin Orthop Relat Res. 1971 Mar-Apr;75:108-16. PMID: 5554614.
Miyamoto RG Jr, Klein GR, Walsh M, Zuckerman JD. Orthopedic surgery residents' study habits and performance on the orthopedic in-training examination. Am J Orthop (Belle Mead NJ). 2007 Dec;36(12):E185-8. PMID: 18264562.
Risner B, Nyland J, Crawford CH 3rd, Roberts CS, Johnson JR. Orthopaedic in-training examination performance: a nine-year review of a residency program database. South Med J. 2008 Aug;101(8):791-6. PMID: 18622350.
Crawford CH 3rd, Nyland J, Roberts CS, Johnson JR. Relationship among United States Medical Licensing Step I, orthopedic in-training, subjective clinical performance evaluations, and american board of orthopedic surgery examination scores: a 12-year review of an orthopedic surgery residency program. J Surg Educ. 2010 Mar-Apr;67(2):71-8. PMID: 20656602.
Dougherty PJ, Walter N, Schilling P, Najibi S, Herkowitz H. Do scores of the USMLE Step 1 and OITE correlate with the ABOS Part I certifying examination?: a multicenter study. Clin Orthop Relat Res. 2010 Oct;468(10):2797-802. PMID: 20352386
Herndon JH, Allan BJ, Dyer G, Jawa A, Zurakowski D. Predictors of success on the American Board of Orthopaedic Surgery examination. Clin Orthop Relat Res. 2009 Sep;467(9):2436-45. PMID: 19557490
Klein GR, Austin MS, Randolph S, Sharkey PF, Hilibrand AS. Passing the Boards: can USMLE and Orthopaedic in-Training Examination scores predict passage of the ABOS Part-I examination? J Bone Joint Surg Am. 2004 May;86(5):1092-5. PMID: 15118058.
Swanson D, Marsh JL, Hurwitz S, DeRosa GP, Holtzman K, Bucak SD, Baker A, Morrison C. Utility of AAOS OITE scores in predicting ABOS Part I outcomes: AAOS exhibit selection. J Bone Joint Surg Am. 2013 Jun 19;95(12):e84. PMID: 23783215.
Raman T, Alrabaa RG, Sood A, Maloof P, Benevenia J, Berberian W. Does Residency Selection Criteria Predict Performance in Orthopaedic Surgery Residency? Clin Orthop Relat Res. 2016 Apr;474(4):908-14. PMID: 25940336.
Dyrstad BW, Pope D, Milbrandt JC, Beck RT, Weinhoeft AL, Idusuyi OB. Predictive measures of a resident's performance on written Orthopaedic Board scores. Iowa Orthop J. 2011;31:238-43. PMID: 22096449
Camp CL, Degen RM, Hanssen AD, Dines JS, Karam MD, Turner NS. Residents and Program Director Perspectives Often Differ on Optimal Preparation Strategies and the Value of the Orthopedic In-Training Examination. J Surg Educ. 2018 Jan-Feb;75(1):164-170. PMID: 28673803.
Franklin CC, Bosch PP, Grudziak JS, Dede O, Ramirez RN, Mendelson SA, Ward WT, Brooks M, Kenkre T, Lubahn JD, Deeney VF, Roach JW. Does a Weekly Didactic Conference Improve Resident Performance on the Pediatric Domain of the Orthopaedic In-Training Examination? J Pediatr Orthop. 2017 Mar;37(2):149-153. PMID: 26866645.
LaPorte DM, Marker DR, Seyler TM, Mont MA, Frassica FJ. Educational resources for the Orthopedic In-Training Examination. J Surg Educ. 2010 May-Jun;67(3):135-8. PMID: 20630421.
Taylor BC, Fowler TT, Dimitris C. Achieving educational excellence: a strategic initiative to enhance orthopedic resident academic performance. J Surg Educ. 2011 May-Jun;68(3):162-6. PMID: 21481797.
Janney CF, Kunzler D, Safavi PS, Panchbhavi V. Orthopaedic In-Training Examination Resources and Residency Training for the Foot and Ankle Domain. Foot Ankle Spec. 2019 Apr;12(2):146-152. PMID: 29707970.
Boody B, Johnson P, Pugely A, Miller D, Geller J, Payne W, Boegener J, Schafer M, Beal M. Validation of a Web-Based Curriculum for Resident Education in Orthopedic Surgery. J Surg Educ. 2016 Nov-Dec;73(6):1060-1065. PMID: 27453538.
Krueger CA, Shakir I, Fuller BC. Prevalence of answers to orthopaedic in-training examination questions in 3 commonly used orthopedic review sources. Orthopedics. 2012 Sep;35(9):e1420-6. PMID: 22955412.
Froelich J, Milbrandt JC, Allan DG. Impact of the 80-hour workweek on surgical exposure and national in-training examination scores in an orthopedic residency program. J Surg Educ. 2009 Mar-Apr;66(2):85-8. PMID: 19486871.
Karlen AI, Solberg EJ, Quanbeck DS, Van Heest AE. Orthopaedic Surgery Residency Rotations and Correlation With Orthopaedic In-Training Examination Performance. J Surg Educ. 2018 Sep-Oct;75(5):1325-1328. PMID: 29449163.
Kragh JF Jr, Robbins J, Ward JA. Faculty turnover and resident in-training examination and board scores. Am J Orthop (Belle Mead NJ). 2007 Dec;36(12):E180-4. PMID: 18264561.
Strauss EJ, Markus DH, Kingery MT, Zuckerman J, Egol KA. Orthopaedic Resident Burnout Is Associated with Poor In-Training Examination Performance. J Bone Joint Surg Am. 2019 Oct 2;101(19):e102. PMID: 31577687.
Bohm KC, Hill BW, Braman JP, Ly TV, Van Heest AE. Orthopedic Residency: Are Duty Hours Predictive of Performance? J Surg Educ. 2016 Mar-Apr;73(2):281-5. PMID: 26774934.
Salazar D, Schiff A, Mitchell E, Hopkinson W. Variability in Accreditation Council for Graduate Medical Education Resident Case Log System practices among orthopaedic surgery residents. J Bone Joint Surg Am. 2014 Feb 5;96(3):e22. PMID: 24500594.
Camp CL, Degen RM, Turner NS, Hanssen AD, Karam MD, Dines JS. Orthopedic In-Training Examination: A Performance Review Based on Program- and Resident-Specific Characteristics. J Surg Educ. 2017 Jul-Aug;74(4):754-761. PMID: 28343951.
Carmichael KD, Westmoreland JB, Thomas JA, Patterson RM. Relation of residency selection factors to subsequent orthopaedic in-training examination performance. South Med J. 2005 May;98(5):528-32. PMID: 15954509.
Kreitz T, Verma S, Adan A, Verma K. Factors Predictive of Orthopaedic In-training Examination Performance and Research Productivity Among Orthopaedic Residents. J Am Acad Orthop Surg. 2019 Mar 15;27(6):e286-e292. PMID: 30252788.
Atesok KI, Hurwitz SR, Egol KA, Ahn J, Owens BD, Crosby LA, Pellegrini VD Jr. Perspective: Integrating research into surgical residency education: lessons learned from orthopaedic surgery. Acad Med. 2012 May;87(5):592-7. doi: 10.1097/ACM.0b013e31824d2b57. PMID: 22450176.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Journal of Orthopaedic Business
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
