The Crisis in Surgical Training & Proficiency-Based Progression (PBP)

Guest: Professor Anthony G Gallagher Topic: The Crisis in Surgical Training & Proficiency-Based Progression (PBP) Episode Summary In this inaugural episode, Patrick Kiely sits down with Professor Tony Gallagher — founder of Proficiency-Based Progression and one of the world's leading researchers in surgical skills assessment and simulation-based training — to examine a deeply uncomfortable truth: that professional credentialing in medicine tells us almost nothing about actual clinical competence. Tony shares 30 years of evidence challenging the assumptions underpinning surgical and procedural training worldwide, and makes the case for Proficiency-Based Progression (PBP) as the superior — and inevitable — alternative. Key Topics Covered 1. The Competence Problem in Surgery — 0:00 Why credentials don't equal competence The Halsted training paradigm — developed in the late 19th/early 20th century — and why it's still in use How to actually find out if your surgeon is good (hint: ask the theater sister) 2. Why Current Training Metrics Are Failing — 5:08 Procedure volume and hours logged as proxies for competence — and why they're wrong The misuse of Likert-type scales in surgical assessment Reduced work hours legislation (Europe/US) and its impact on trainee experience The Libby Zion case (New York) and how it changed US residency hours 3. The Yale Study That Changed Everything — 9:53 The landmark 2002 Yale study showing simulator-trained residents made 60% fewer errors Why it became a citation classic — and why change was still slow Publication:  Gallagher & Seymour (2002). Virtual reality training for laparoscopic surgery. Annals of Surgery, October 2002. (Presented at American Surgical Association, April 2002) https://journals.lww.com/annalsofsurgery/abstract/2002/10000/virtual_reality_training_improves_operating_room.8.aspx 4. The American College of Surgeons Response — 12:29 Gerry Healy's pivotal leadership shift at the Boston meeting The establishment of Accredited Educational Institutes (2006) Why 100+ accredited simulation centers still aren't producing the training outcomes expected 5. The Experience ≠ Competence Myth — 16:47 Why procedure volume is a noisy surrogate for surgical skill How some practicing consultants perform worse than residents in training Objective intraoperative performance assessment as the gold standard 6. Proficiency-Based Progression: How It Works — 20:30 The mechanics of PBP: phases, steps, errors, critical errors, and the benchmark Establishing benchmarks from experienced — not world-class — practitioners Construct validity, inter-rater reliability, and why Likert scales fail The role of deliberate practice (Ericsson) and why explicit, formative feedback accelerates learning Publication: Mazzone, Elio; Puliatti, Stefano MD; Amato, Marco; Bunting, Brendan; Rocco, Bernardo; Montorsi, Francesco; Mottrie, Alexandre; Gallagher, Anthony G. PhD, DSc||. A Systematic Review and Meta-analysis on the Impact of Proficiency-based Progression Simulation Training on Performance Outcomes. Annals of Surgery 274(2):p 281-289, August 2021. | DOI: 10.1097/SLA.0000000000004650 7. Why PBP Hasn't Been Adopted Universally — 35:27 "It's a failure of leadership" Organisations that have adopted PBP: AANA, ERUS, ORSI Academy Incentive structures in healthcare and medical device manufacturing that slow adoption The Center for Medicare Services complication-rate accountability model as a potential lever 8. The Economics of PBP — 37:49 Publication: Puliatti, S., Rodriguez Peñaranda, N., Amato, M., De Groote, R., Farinha, R., Bunting, B., van Cleynenbreugel, B., Mottrie, A. and Gallagher, A.G. (2026), Randomised trial on the economic impact of proficiency-based progression vs conventional robotic surgical training. BJU Int, 137: 493-501. https://doi.org/10.1111/bju.70130 https://bjui-journals.onlinelibrary.wiley.com/doi/full/10.1111/bju.70130 — Cost-effectiveness analysis of PBP vs. conventional training. At