A portable hip arthroscopy simulator demonstrates good face and content validity with incomplete construct validity

Purpose: We evaluate the face, content, and construct validity of a portable hip arthroscopy module in a regional orthopaedic unit. Methods: Participants were recruited from a regional orthopaedic centre, and categorized into novice (0 arthroscopies), intermediate (1-29 arthroscopies), and expert (>50 arthroscopies) groups based on reported experience in arthroscopy. Face and content validity was evaluated by feedback from users immediately following completion of modules. Objective measurements, including time taken and subjective measurements consisting of simulation software metrics including, cam lesion locations attempts, scope strikes on bone, healthy bone burred, and cam lesion burred. Scores achieved by experts were recorded, and the median score was set at the level at which proficiency was demonstrated. Participant feedback on perceived educational use was collected following completion. Results: In total, 20 participant results were included for analysis. Good face and content validity was expressed by participants with previous arthroscopic experience. Number of scope strikes within the simulator-derived metrics accurately discerned between levels of experience. Novices had a mean of 5 strikes per attempt (SD ±5); intermediates a mean of 5.8 strikes (SD ± 4.1). There was a significant difference between expert and novice groups (P = .01), and expert and intermediate groups (P = .002). No significant difference between overall performance scores achieved by participants in expert, intermediate, and novice groups (62% ± 19 vs 55% ± 22 vs 50% ± 23; P = .15). This demonstrates incomplete construct validity of the simulator software-derived metrics. Conclusions: This hip arthroscopy simulator demonstrated acceptable face and content validity, with incomplete construct validity of simulator software metrics. Participants reported high levels of satisfaction with the module, highlighting that the addition of haptic feedback would be beneficial to improve procedural steps. Incorporation of tactile feedback to the modulator components would likely enable the software to accurately delineate between levels of experience. Clinical Relevance: This study demonstrates good face and content validity. The addition of haptic feedback in a hip arthroscopy simulator may improve learning.