Interventional radiology clinical practice guideline recommendations for neurovascular disorders are not based on high-quality systematic reviews

A. B. Chong, M. Taylor, G. Schubert, Matt Vassar

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

BACKGROUND: In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception. PURPOSE: Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology. DATA SOURCES: Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology. STUDY SELECTION: We selected 65 systematic reviews and meta-analyses. DATA ANALYSIS: A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items. DATA SYNTHESIS: On the basis of AMSTAR scores, 3 (4.62%) reviews were high-quality, 28 reviews (43.08%) were moderate-quality, and 34 reviews (52.31%) were low-quality, with an average quality score of 3.66 (34.32%; minimum, 0%; maximum, 81.82%). The average PRISMA score was 18.18 (69.41%). LIMITATIONS: We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews. CONCLUSIONS: The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines.

Original languageEnglish
Pages (from-to)759-765
Number of pages7
JournalAmerican Journal of Neuroradiology
Volume38
Issue number4
DOIs
StatePublished - 1 Apr 2017

Fingerprint

Interventional Radiology
Practice Guidelines
Meta-Analysis
Medicine
Databases
Research

Cite this

@article{ce092c99206f492ba2a3a063597d3a8c,
title = "Interventional radiology clinical practice guideline recommendations for neurovascular disorders are not based on high-quality systematic reviews",
abstract = "BACKGROUND: In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception. PURPOSE: Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology. DATA SOURCES: Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology. STUDY SELECTION: We selected 65 systematic reviews and meta-analyses. DATA ANALYSIS: A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items. DATA SYNTHESIS: On the basis of AMSTAR scores, 3 (4.62{\%}) reviews were high-quality, 28 reviews (43.08{\%}) were moderate-quality, and 34 reviews (52.31{\%}) were low-quality, with an average quality score of 3.66 (34.32{\%}; minimum, 0{\%}; maximum, 81.82{\%}). The average PRISMA score was 18.18 (69.41{\%}). LIMITATIONS: We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews. CONCLUSIONS: The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines.",
author = "Chong, {A. B.} and M. Taylor and G. Schubert and Matt Vassar",
year = "2017",
month = "4",
day = "1",
doi = "10.3174/ajnr.A5079",
language = "English",
volume = "38",
pages = "759--765",
journal = "American Journal of Neuroradiology",
issn = "0195-6108",
publisher = "American Society of Neuroradiology",
number = "4",

}

TY - JOUR

T1 - Interventional radiology clinical practice guideline recommendations for neurovascular disorders are not based on high-quality systematic reviews

AU - Chong, A. B.

AU - Taylor, M.

AU - Schubert, G.

AU - Vassar, Matt

PY - 2017/4/1

Y1 - 2017/4/1

N2 - BACKGROUND: In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception. PURPOSE: Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology. DATA SOURCES: Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology. STUDY SELECTION: We selected 65 systematic reviews and meta-analyses. DATA ANALYSIS: A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items. DATA SYNTHESIS: On the basis of AMSTAR scores, 3 (4.62%) reviews were high-quality, 28 reviews (43.08%) were moderate-quality, and 34 reviews (52.31%) were low-quality, with an average quality score of 3.66 (34.32%; minimum, 0%; maximum, 81.82%). The average PRISMA score was 18.18 (69.41%). LIMITATIONS: We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews. CONCLUSIONS: The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines.

AB - BACKGROUND: In recent years, clinical practice guidelines have been criticized for biased interpretations of research evidence, and interventional radiology is no exception. PURPOSE: Our aim was to evaluate the methodologic quality and transparency of reporting in systematic reviews used as evidence in interventional radiology clinical practice guidelines for neurovascular disorders from the Society of Interventional Radiology. DATA SOURCES: Our sources were 9 neurovascular disorder clinical practice guidelines from the Society of Interventional Radiology. STUDY SELECTION: We selected 65 systematic reviews and meta-analyses. DATA ANALYSIS: A Measurement Tool to Assess Systematic Reviews (AMSTAR) and Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) tools were used to assess the methodologic quality and reporting transparency of systematic reviews. Radial plots were created on the basis of average scores for PRISMA and AMSTAR items. DATA SYNTHESIS: On the basis of AMSTAR scores, 3 (4.62%) reviews were high-quality, 28 reviews (43.08%) were moderate-quality, and 34 reviews (52.31%) were low-quality, with an average quality score of 3.66 (34.32%; minimum, 0%; maximum, 81.82%). The average PRISMA score was 18.18 (69.41%). LIMITATIONS: We were unable to obtain previous versions for 8 reviews, 7 of which were from the Cochrane Database of Systematic Reviews. CONCLUSIONS: The methodologic quality of systematic reviews needs to be improved. Although reporting clarity was much better than the methodologic quality, it still has room for improvement. The methodologic quality and transparency of reporting did not vary much among clinical practice guidelines. This study can also be applied to other medical specialties to examine the quality of studies used as evidence in their own clinical practice guidelines.

UR - http://www.scopus.com/inward/record.url?scp=85017633665&partnerID=8YFLogxK

U2 - 10.3174/ajnr.A5079

DO - 10.3174/ajnr.A5079

M3 - Article

C2 - 28154125

AN - SCOPUS:85017633665

VL - 38

SP - 759

EP - 765

JO - American Journal of Neuroradiology

JF - American Journal of Neuroradiology

SN - 0195-6108

IS - 4

ER -