Evaluation of the NCCN guidelines using the RIGHT Statement and AGREE-II instrument: A cross-sectional review

Research output: Contribution to journalReview article

Abstract

Introduction: Robust, clearly reported clinical practice guidelines (CPGs) are essential for evidence-based clinical practice. The Reporting Items for practice Guidelines in HealThcare (RIGHT) Statement and Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument were published to improve the methodological and reporting quality in healthcare CPGs. Methods: We applied the RIGHT Statement checklist and AGREE-II instrument to 48 National Comprehensive Cancer Network (NCCN) guidelines. Our primary objective was to assess the adherence to RIGHT and AGREE-II items. Since neither RIGHT nor AGREE-II can judge the clinical usefulness of a guideline, our study is designed to only focus on the methodological and reporting quality of each guideline. Results: The NCCN guidelines demonstrated notable strengths and weaknesses. For example, RIGHT Statement items 19 (conflicts of interest), 7b (description of subgroups) and 13a (clear, precise recommendations) were fully reported in all guidelines. However, the guidelines inconsistently incorporated patient values and preferences and cost. Regarding the AGREE-II instrument, the NCCN guidelines scored highly on the domains 4 (clear, precise recommendations) and 6 (handling of conflicts of interest), but lowest on domain 2 (inclusion of all relevant stakeholders). Conclusions: In this investigation, we found that NCCN CPGs demonstrate key strengths and weaknesses with respect to the reporting of key items essential to CPGs. We recommend the continued use of NCCN guidelines and improvements to weaknesses in reporting and methods. Doing so serves to improve the evidence delivered to healthcare providers, thus potentially improving patient care.

Original languageEnglish
JournalBMJ Evidence-Based Medicine
DOIs
StatePublished - 1 Jan 2019

Fingerprint

Practice Guidelines
Guidelines
Delivery of Health Care
Neoplasms
Conflict of Interest
Patient Preference
Quality of Health Care
Evidence-Based Practice
Checklist
Health Personnel
Patient Care
Costs and Cost Analysis

Keywords

  • oncology

Cite this

@article{a4c8b6ab56af416db95054faff623af1,
title = "Evaluation of the NCCN guidelines using the RIGHT Statement and AGREE-II instrument: A cross-sectional review",
abstract = "Introduction: Robust, clearly reported clinical practice guidelines (CPGs) are essential for evidence-based clinical practice. The Reporting Items for practice Guidelines in HealThcare (RIGHT) Statement and Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument were published to improve the methodological and reporting quality in healthcare CPGs. Methods: We applied the RIGHT Statement checklist and AGREE-II instrument to 48 National Comprehensive Cancer Network (NCCN) guidelines. Our primary objective was to assess the adherence to RIGHT and AGREE-II items. Since neither RIGHT nor AGREE-II can judge the clinical usefulness of a guideline, our study is designed to only focus on the methodological and reporting quality of each guideline. Results: The NCCN guidelines demonstrated notable strengths and weaknesses. For example, RIGHT Statement items 19 (conflicts of interest), 7b (description of subgroups) and 13a (clear, precise recommendations) were fully reported in all guidelines. However, the guidelines inconsistently incorporated patient values and preferences and cost. Regarding the AGREE-II instrument, the NCCN guidelines scored highly on the domains 4 (clear, precise recommendations) and 6 (handling of conflicts of interest), but lowest on domain 2 (inclusion of all relevant stakeholders). Conclusions: In this investigation, we found that NCCN CPGs demonstrate key strengths and weaknesses with respect to the reporting of key items essential to CPGs. We recommend the continued use of NCCN guidelines and improvements to weaknesses in reporting and methods. Doing so serves to improve the evidence delivered to healthcare providers, thus potentially improving patient care.",
keywords = "oncology",
author = "Cole Wayant and Craig Cooper and D'Arcy Turner and Matt Vassar",
year = "2019",
month = "1",
day = "1",
doi = "10.1136/bmjebm-2018-111153",
language = "English",
journal = "BMJ evidence-based medicine",
issn = "2515-446X",
publisher = "BMJ Publishing Group",

}

TY - JOUR

T1 - Evaluation of the NCCN guidelines using the RIGHT Statement and AGREE-II instrument

T2 - A cross-sectional review

AU - Wayant, Cole

AU - Cooper, Craig

AU - Turner, D'Arcy

AU - Vassar, Matt

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Introduction: Robust, clearly reported clinical practice guidelines (CPGs) are essential for evidence-based clinical practice. The Reporting Items for practice Guidelines in HealThcare (RIGHT) Statement and Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument were published to improve the methodological and reporting quality in healthcare CPGs. Methods: We applied the RIGHT Statement checklist and AGREE-II instrument to 48 National Comprehensive Cancer Network (NCCN) guidelines. Our primary objective was to assess the adherence to RIGHT and AGREE-II items. Since neither RIGHT nor AGREE-II can judge the clinical usefulness of a guideline, our study is designed to only focus on the methodological and reporting quality of each guideline. Results: The NCCN guidelines demonstrated notable strengths and weaknesses. For example, RIGHT Statement items 19 (conflicts of interest), 7b (description of subgroups) and 13a (clear, precise recommendations) were fully reported in all guidelines. However, the guidelines inconsistently incorporated patient values and preferences and cost. Regarding the AGREE-II instrument, the NCCN guidelines scored highly on the domains 4 (clear, precise recommendations) and 6 (handling of conflicts of interest), but lowest on domain 2 (inclusion of all relevant stakeholders). Conclusions: In this investigation, we found that NCCN CPGs demonstrate key strengths and weaknesses with respect to the reporting of key items essential to CPGs. We recommend the continued use of NCCN guidelines and improvements to weaknesses in reporting and methods. Doing so serves to improve the evidence delivered to healthcare providers, thus potentially improving patient care.

AB - Introduction: Robust, clearly reported clinical practice guidelines (CPGs) are essential for evidence-based clinical practice. The Reporting Items for practice Guidelines in HealThcare (RIGHT) Statement and Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument were published to improve the methodological and reporting quality in healthcare CPGs. Methods: We applied the RIGHT Statement checklist and AGREE-II instrument to 48 National Comprehensive Cancer Network (NCCN) guidelines. Our primary objective was to assess the adherence to RIGHT and AGREE-II items. Since neither RIGHT nor AGREE-II can judge the clinical usefulness of a guideline, our study is designed to only focus on the methodological and reporting quality of each guideline. Results: The NCCN guidelines demonstrated notable strengths and weaknesses. For example, RIGHT Statement items 19 (conflicts of interest), 7b (description of subgroups) and 13a (clear, precise recommendations) were fully reported in all guidelines. However, the guidelines inconsistently incorporated patient values and preferences and cost. Regarding the AGREE-II instrument, the NCCN guidelines scored highly on the domains 4 (clear, precise recommendations) and 6 (handling of conflicts of interest), but lowest on domain 2 (inclusion of all relevant stakeholders). Conclusions: In this investigation, we found that NCCN CPGs demonstrate key strengths and weaknesses with respect to the reporting of key items essential to CPGs. We recommend the continued use of NCCN guidelines and improvements to weaknesses in reporting and methods. Doing so serves to improve the evidence delivered to healthcare providers, thus potentially improving patient care.

KW - oncology

UR - http://www.scopus.com/inward/record.url?scp=85063468803&partnerID=8YFLogxK

U2 - 10.1136/bmjebm-2018-111153

DO - 10.1136/bmjebm-2018-111153

M3 - Review article

AN - SCOPUS:85063468803

JO - BMJ evidence-based medicine

JF - BMJ evidence-based medicine

SN - 2515-446X

ER -