Skip to main content
RACS ASC 2025
Comparison of Quality Evaluation of Surgical Clinical Practice Guidelines using AGREE-II and AGREE-S Tools
Poster
Edit Your Submission
Edit

Poster

Presentation Description

Institution: University of Adelaide - SA, Australia

Background: Clinical practice guideline development continues to increase worldwide. AGREE-II is a well-recognized tool for the evaluation of the quality of guidelines. A surgical extension, AGREE-S, was developed in 2022. We aim to evaluate the difference in appraisal of surgical clinical practice guidelines using AGREE-S versus AGREE-II. Methods: A systematic review was conducted using Pubmed and the International Guidelines Library to ultimately identify twenty surgical, interventional and procedural-related guidelines. A minimum of four different appraisers used both AGREE-II and AGREE-S to evaluate all twenty guidelines. A univariate linear mixed-effects regression model was used to compare scoring between the domains in each tool (95% CI, p-value <0.05) and intraclass correlation coefficient (ICC) was used to determine reliability (p-value <0.05). Results: Four of the seven different domain comparisons conducted between the two instruments demonstrated a statistically significant mean difference with the largest seen in Clarity of Presentation in AGREE-II versus Development of Recommendations in AGREE-S. Overall quality for surgical guidelines was a median of 4.1 out of 7. Only two guidelines had a unanimous decision amongst all reviewers to recommend without modification. Both tools demonstrated good reliability with an average ICC of 0.81 (0.78,0.083; p-value <0.001). Conclusions: The AGREE-S extension helps provide a more rigorous and relevant evaluation of the guidelines developed for surgical and procedural applications compared to AGREE-II. Future research and application of AGREE-S will be critical in validating its effectiveness and promoting its adoption into surgical guideline development and appraisal.
Presenters
Authors
Authors

Dr Elisa Calabrese - , Amy Martin - , Aparajitha Raamkummar - , Dr Bright Huo - , Dr Geoffrey Kohn - , Dr Wendy Babidge - , Dr Emily Miraflor - , Prof Guy Maddern -