J Minim Invasive Gynecol. 2021 May 16:S1553-4650(21)00224-7. doi: 10.1016/j.jmig.2021.05.002. Online ahead of print.
ABSTRACT
STUDY OBJECTIVE: The “illusion of validity” is a cognitive bias in which the ability to interpret and predict surgical performance accurately is overestimated. To address this bias, we assessed participants comparing FLS and non FLS tasks to cadaveric vaginal cuff suturing in order to determine the most representative simulation task for laparoscopic vaginal cuff suturing.
DESIGN: Validity (Messick Framework) study comparing FLS and non-FLS tasks to cadaveric vaginal cuff suturing.
SETTING: Simulation center cadaver lab PARTICIPANTS: : Obstetrics and gynecology residents (n=21), minimally invasive gynecologic surgery fellows (n=3), gynecologic surgical subspecialists (n=4), general obstetrician/gynecologists (n=10).
INTERVENTIONS: Tasks included a simulated vaginal cuff (ipsilateral port placement), needle passage through a metal eyelet loop (contralateral and ipsilateral), and intracorporeal knot tying (contralateral and ipsilateral). Simulation task times were compared to the placement of the first cadaveric vaginal cuff suture time, as well as the in-person and blinded Global Operative Assessment of Laparoscopic Skills (GOALS) score (“relations to other variables” validity evidence). Statistical analyses included Spearman’s test of correlation (continuous and ordinal variables) or Wilcoxon rank sum test (categorical variables).
MEASUREMENTS AND MAIN RESULTS: There was a stronger association with cadaver cuff suturing time for simulated vaginal cuff suturing time (r: 0.73, P<0.001) compared to FLS intracorporeal contralateral suturing time (r: 0.54, P<0.001). Additional measures associated with cadaveric performance included subspecialty training (Median: 82 vs. 185 seconds, P=0.002), number of total laparoscopic hysterectomies (r: -0.53, P<0.001), number of laparoscopic cuff closures (r: -0.61, P<0.001), number of simulated laparoscopic suturing experiences (r: -0.51, P<0.001), and eyelet contralateral time (r: 0.52, P<0.001). Strong agreement between the in-person and blinded GOALS (ICC=0.80) supports response process evidence. Correlations of cadaver cuff time with in-person (Spearman’s r: -0.84, P<0.001), and blinded GOALS (r: -0.76, P<0.001) supports relations to other variables evidence CONCLUSION: : The weaker correlation between FLS suturing and cadaver cuff suturing compared to a simulated vaginal cuff model may lead to an “illusion of validity” for assessment in gynecology. Since gynecology specific validity evidence has not been well established for FLS, we recommend prioritizing the use of a simulated-vaginal cuff suturing assessment in addition to FLS.
PMID:34010696 | DOI:10.1016/j.jmig.2021.05.002
