Treating schizophrenia: The quality of evidence behind treatment recommendations and how it can improve

Greg Aran, Chandler Hicks, Alexander Demand, Austin L. Johnson, Jason Beaman, Yakiji Bailey, Melissa Haught, Aaron Lane, Philip Sinnett, Matt Vassar

Research output: Contribution to journalArticle

Abstract

Objective: To assess the methodological and reporting quality of systematic reviews that comprise the American Psychiatric Association (APA) Practice Guideline for the Treatment ofPatientswith Schizophrenia and to determine the extent to which results from Cochrane systematic reviews published after guideline development would alter or confirm current recommendations. Participants: Systematic reviews that underpinned recommendations in the APA guidelines and Cochrane systematic reviews. Main outcome: Three independent reviewers scored all systematic reviews referenced in the guideline for quality and reporting using AMSTAR and PRISMA checklist, respectively. Items in both tools were individually graded and compared to identify consistently low-performing areas within the systematic reviews. Post hoc analysis of the Cochrane systematic reviews since the latest revision of APA's guidelines were performed to determine whether their findings were congruent with recent recommendations. Results: The mean score of the 57 reviews on the PRISMA checklist was 70%. The mean AMSTAR score was 6.8, correlating with a moderate quality score. Post hoc analysis revealed that 171 Cochrane reviews had been published since the APA guideline release. Only half of the reviews of pharmacological interventions confirmed current recommendations. Conclusions and relevance: The methodological quality of the systematic reviews included in the APA guideline was deficient in key areas. Our study brings to light the importance of using high-quality evidence in the development of clinical practice guidelines. An updated APA guideline (last updated in 2009) is necessary to provide the highest quality treatment recommendations for clinicians in the management of schizophrenia. Trial registration number: UMIN-CTR, UMIN000023099.

Original languageEnglish
JournalBMJ Evidence-Based Medicine
DOIs
StateAccepted/In press - 1 Jan 2019

Fingerprint

Schizophrenia
Guidelines
Psychiatry
Checklist
Practice Guidelines
Pharmacology

Keywords

  • american psychiatry association
  • AMSTAR
  • cochrane
  • guidelines
  • PRISMA
  • schizophrenia
  • systematic reviews

Cite this

@article{17bf8a6fc210460ca75185be75ac85ce,
title = "Treating schizophrenia: The quality of evidence behind treatment recommendations and how it can improve",
abstract = "Objective: To assess the methodological and reporting quality of systematic reviews that comprise the American Psychiatric Association (APA) Practice Guideline for the Treatment ofPatientswith Schizophrenia and to determine the extent to which results from Cochrane systematic reviews published after guideline development would alter or confirm current recommendations. Participants: Systematic reviews that underpinned recommendations in the APA guidelines and Cochrane systematic reviews. Main outcome: Three independent reviewers scored all systematic reviews referenced in the guideline for quality and reporting using AMSTAR and PRISMA checklist, respectively. Items in both tools were individually graded and compared to identify consistently low-performing areas within the systematic reviews. Post hoc analysis of the Cochrane systematic reviews since the latest revision of APA's guidelines were performed to determine whether their findings were congruent with recent recommendations. Results: The mean score of the 57 reviews on the PRISMA checklist was 70{\%}. The mean AMSTAR score was 6.8, correlating with a moderate quality score. Post hoc analysis revealed that 171 Cochrane reviews had been published since the APA guideline release. Only half of the reviews of pharmacological interventions confirmed current recommendations. Conclusions and relevance: The methodological quality of the systematic reviews included in the APA guideline was deficient in key areas. Our study brings to light the importance of using high-quality evidence in the development of clinical practice guidelines. An updated APA guideline (last updated in 2009) is necessary to provide the highest quality treatment recommendations for clinicians in the management of schizophrenia. Trial registration number: UMIN-CTR, UMIN000023099.",
keywords = "american psychiatry association, AMSTAR, cochrane, guidelines, PRISMA, schizophrenia, systematic reviews",
author = "Greg Aran and Chandler Hicks and Alexander Demand and Johnson, {Austin L.} and Jason Beaman and Yakiji Bailey and Melissa Haught and Aaron Lane and Philip Sinnett and Matt Vassar",
year = "2019",
month = "1",
day = "1",
doi = "10.1136/bmjebm-2019-111233",
language = "English",
journal = "BMJ evidence-based medicine",
issn = "2515-446X",
publisher = "BMJ Publishing Group",

}

TY - JOUR

T1 - Treating schizophrenia

T2 - The quality of evidence behind treatment recommendations and how it can improve

AU - Aran, Greg

AU - Hicks, Chandler

AU - Demand, Alexander

AU - Johnson, Austin L.

AU - Beaman, Jason

AU - Bailey, Yakiji

AU - Haught, Melissa

AU - Lane, Aaron

AU - Sinnett, Philip

AU - Vassar, Matt

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Objective: To assess the methodological and reporting quality of systematic reviews that comprise the American Psychiatric Association (APA) Practice Guideline for the Treatment ofPatientswith Schizophrenia and to determine the extent to which results from Cochrane systematic reviews published after guideline development would alter or confirm current recommendations. Participants: Systematic reviews that underpinned recommendations in the APA guidelines and Cochrane systematic reviews. Main outcome: Three independent reviewers scored all systematic reviews referenced in the guideline for quality and reporting using AMSTAR and PRISMA checklist, respectively. Items in both tools were individually graded and compared to identify consistently low-performing areas within the systematic reviews. Post hoc analysis of the Cochrane systematic reviews since the latest revision of APA's guidelines were performed to determine whether their findings were congruent with recent recommendations. Results: The mean score of the 57 reviews on the PRISMA checklist was 70%. The mean AMSTAR score was 6.8, correlating with a moderate quality score. Post hoc analysis revealed that 171 Cochrane reviews had been published since the APA guideline release. Only half of the reviews of pharmacological interventions confirmed current recommendations. Conclusions and relevance: The methodological quality of the systematic reviews included in the APA guideline was deficient in key areas. Our study brings to light the importance of using high-quality evidence in the development of clinical practice guidelines. An updated APA guideline (last updated in 2009) is necessary to provide the highest quality treatment recommendations for clinicians in the management of schizophrenia. Trial registration number: UMIN-CTR, UMIN000023099.

AB - Objective: To assess the methodological and reporting quality of systematic reviews that comprise the American Psychiatric Association (APA) Practice Guideline for the Treatment ofPatientswith Schizophrenia and to determine the extent to which results from Cochrane systematic reviews published after guideline development would alter or confirm current recommendations. Participants: Systematic reviews that underpinned recommendations in the APA guidelines and Cochrane systematic reviews. Main outcome: Three independent reviewers scored all systematic reviews referenced in the guideline for quality and reporting using AMSTAR and PRISMA checklist, respectively. Items in both tools were individually graded and compared to identify consistently low-performing areas within the systematic reviews. Post hoc analysis of the Cochrane systematic reviews since the latest revision of APA's guidelines were performed to determine whether their findings were congruent with recent recommendations. Results: The mean score of the 57 reviews on the PRISMA checklist was 70%. The mean AMSTAR score was 6.8, correlating with a moderate quality score. Post hoc analysis revealed that 171 Cochrane reviews had been published since the APA guideline release. Only half of the reviews of pharmacological interventions confirmed current recommendations. Conclusions and relevance: The methodological quality of the systematic reviews included in the APA guideline was deficient in key areas. Our study brings to light the importance of using high-quality evidence in the development of clinical practice guidelines. An updated APA guideline (last updated in 2009) is necessary to provide the highest quality treatment recommendations for clinicians in the management of schizophrenia. Trial registration number: UMIN-CTR, UMIN000023099.

KW - american psychiatry association

KW - AMSTAR

KW - cochrane

KW - guidelines

KW - PRISMA

KW - schizophrenia

KW - systematic reviews

UR - http://www.scopus.com/inward/record.url?scp=85074583404&partnerID=8YFLogxK

U2 - 10.1136/bmjebm-2019-111233

DO - 10.1136/bmjebm-2019-111233

M3 - Article

C2 - 31672699

AN - SCOPUS:85074583404

JO - BMJ evidence-based medicine

JF - BMJ evidence-based medicine

SN - 2515-446X

ER -