Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children

Jonathan D. Lichtenstein, Laszlo A. Erdodi, Jaspreet K. Rai, Anna Mazur-Mosiewicz, Lloyd Flaro

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Past studies have examined the ability of the Wisconsin Card Sorting Test (WCST) to discriminate valid from invalid performance in adults using both individual embedded validity indicators (EVIs) and multivariate approaches. This study is designed to investigate whether the two most stable of these indicators—failures to maintain set (FMS) and the logistical regression equation S-BLRE—can be extended to pediatric populations. The classification accuracy for FMS and S-BLRE was examined in a mixed clinical sample of 226 children aged 7 to 17 years (64.6% male, MAge = 13.6 years) against a combination of established performance validity tests (PVTs). The results show that at adult cutoffs, FMS and S-BLRE produce an unacceptably high failure rate (33.2% and 45.6%) and low specificity (.55–.72), but an upward adjustment in cutoffs significantly improves classification accuracy. Defining Pass as <2 and Fail as ≥4 on FMS results in consistently good specificity (.89–.92) but low and variable sensitivity (.00–.33). Similarly, cutting the S-BLRE distribution at 3.68 produces good specificity (.90–.92) but variable sensitivity (.06–.38). Passing or failing FMS or S-BLRE is unrelated to age, gender and IQ. The data from this study suggest that in a pediatric sample, adjusted cutoffs on the FMS and S-BLRE ensure good specificity, but with low or variable sensitivity. Thus, they should not be used in isolation to determine the credibility of a response set. At the same time, they can make valuable contributions to pediatric neuropsychology by providing empirically-supported, expedient and cost-effective indicators to enhance performance validity assessment.

Original languageEnglish
Pages (from-to)247-260
Number of pages14
JournalChild Neuropsychology
Volume24
Issue number2
DOIs
StatePublished - 17 Feb 2018

Fingerprint

Pediatrics
Social Adjustment
Neuropsychology
Aptitude
Costs and Cost Analysis
Population

Keywords

  • Effort testing
  • Embedded validity indicators
  • Pediatric PVTs
  • Pediatric neuropsychological assessment
  • Performance validity testing
  • WCST

Cite this

Lichtenstein, Jonathan D. ; Erdodi, Laszlo A. ; Rai, Jaspreet K. ; Mazur-Mosiewicz, Anna ; Flaro, Lloyd. / Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children. In: Child Neuropsychology. 2018 ; Vol. 24, No. 2. pp. 247-260.
@article{ce6492b9fe144f88962eac84bcb5cc37,
title = "Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children",
abstract = "Past studies have examined the ability of the Wisconsin Card Sorting Test (WCST) to discriminate valid from invalid performance in adults using both individual embedded validity indicators (EVIs) and multivariate approaches. This study is designed to investigate whether the two most stable of these indicators—failures to maintain set (FMS) and the logistical regression equation S-BLRE—can be extended to pediatric populations. The classification accuracy for FMS and S-BLRE was examined in a mixed clinical sample of 226 children aged 7 to 17 years (64.6{\%} male, MAge = 13.6 years) against a combination of established performance validity tests (PVTs). The results show that at adult cutoffs, FMS and S-BLRE produce an unacceptably high failure rate (33.2{\%} and 45.6{\%}) and low specificity (.55–.72), but an upward adjustment in cutoffs significantly improves classification accuracy. Defining Pass as <2 and Fail as ≥4 on FMS results in consistently good specificity (.89–.92) but low and variable sensitivity (.00–.33). Similarly, cutting the S-BLRE distribution at 3.68 produces good specificity (.90–.92) but variable sensitivity (.06–.38). Passing or failing FMS or S-BLRE is unrelated to age, gender and IQ. The data from this study suggest that in a pediatric sample, adjusted cutoffs on the FMS and S-BLRE ensure good specificity, but with low or variable sensitivity. Thus, they should not be used in isolation to determine the credibility of a response set. At the same time, they can make valuable contributions to pediatric neuropsychology by providing empirically-supported, expedient and cost-effective indicators to enhance performance validity assessment.",
keywords = "Effort testing, Embedded validity indicators, Pediatric PVTs, Pediatric neuropsychological assessment, Performance validity testing, WCST",
author = "Lichtenstein, {Jonathan D.} and Erdodi, {Laszlo A.} and Rai, {Jaspreet K.} and Anna Mazur-Mosiewicz and Lloyd Flaro",
year = "2018",
month = "2",
day = "17",
doi = "10.1080/09297049.2016.1259402",
language = "English",
volume = "24",
pages = "247--260",
journal = "Child Neuropsychology",
issn = "0929-7049",
publisher = "Taylor and Francis Ltd.",
number = "2",

}

Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children. / Lichtenstein, Jonathan D.; Erdodi, Laszlo A.; Rai, Jaspreet K.; Mazur-Mosiewicz, Anna; Flaro, Lloyd.

In: Child Neuropsychology, Vol. 24, No. 2, 17.02.2018, p. 247-260.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Wisconsin Card Sorting Test embedded validity indicators developed for adults can be extended to children

AU - Lichtenstein, Jonathan D.

AU - Erdodi, Laszlo A.

AU - Rai, Jaspreet K.

AU - Mazur-Mosiewicz, Anna

AU - Flaro, Lloyd

PY - 2018/2/17

Y1 - 2018/2/17

N2 - Past studies have examined the ability of the Wisconsin Card Sorting Test (WCST) to discriminate valid from invalid performance in adults using both individual embedded validity indicators (EVIs) and multivariate approaches. This study is designed to investigate whether the two most stable of these indicators—failures to maintain set (FMS) and the logistical regression equation S-BLRE—can be extended to pediatric populations. The classification accuracy for FMS and S-BLRE was examined in a mixed clinical sample of 226 children aged 7 to 17 years (64.6% male, MAge = 13.6 years) against a combination of established performance validity tests (PVTs). The results show that at adult cutoffs, FMS and S-BLRE produce an unacceptably high failure rate (33.2% and 45.6%) and low specificity (.55–.72), but an upward adjustment in cutoffs significantly improves classification accuracy. Defining Pass as <2 and Fail as ≥4 on FMS results in consistently good specificity (.89–.92) but low and variable sensitivity (.00–.33). Similarly, cutting the S-BLRE distribution at 3.68 produces good specificity (.90–.92) but variable sensitivity (.06–.38). Passing or failing FMS or S-BLRE is unrelated to age, gender and IQ. The data from this study suggest that in a pediatric sample, adjusted cutoffs on the FMS and S-BLRE ensure good specificity, but with low or variable sensitivity. Thus, they should not be used in isolation to determine the credibility of a response set. At the same time, they can make valuable contributions to pediatric neuropsychology by providing empirically-supported, expedient and cost-effective indicators to enhance performance validity assessment.

AB - Past studies have examined the ability of the Wisconsin Card Sorting Test (WCST) to discriminate valid from invalid performance in adults using both individual embedded validity indicators (EVIs) and multivariate approaches. This study is designed to investigate whether the two most stable of these indicators—failures to maintain set (FMS) and the logistical regression equation S-BLRE—can be extended to pediatric populations. The classification accuracy for FMS and S-BLRE was examined in a mixed clinical sample of 226 children aged 7 to 17 years (64.6% male, MAge = 13.6 years) against a combination of established performance validity tests (PVTs). The results show that at adult cutoffs, FMS and S-BLRE produce an unacceptably high failure rate (33.2% and 45.6%) and low specificity (.55–.72), but an upward adjustment in cutoffs significantly improves classification accuracy. Defining Pass as <2 and Fail as ≥4 on FMS results in consistently good specificity (.89–.92) but low and variable sensitivity (.00–.33). Similarly, cutting the S-BLRE distribution at 3.68 produces good specificity (.90–.92) but variable sensitivity (.06–.38). Passing or failing FMS or S-BLRE is unrelated to age, gender and IQ. The data from this study suggest that in a pediatric sample, adjusted cutoffs on the FMS and S-BLRE ensure good specificity, but with low or variable sensitivity. Thus, they should not be used in isolation to determine the credibility of a response set. At the same time, they can make valuable contributions to pediatric neuropsychology by providing empirically-supported, expedient and cost-effective indicators to enhance performance validity assessment.

KW - Effort testing

KW - Embedded validity indicators

KW - Pediatric PVTs

KW - Pediatric neuropsychological assessment

KW - Performance validity testing

KW - WCST

UR - http://www.scopus.com/inward/record.url?scp=84997703618&partnerID=8YFLogxK

U2 - 10.1080/09297049.2016.1259402

DO - 10.1080/09297049.2016.1259402

M3 - Article

C2 - 27892806

AN - SCOPUS:84997703618

VL - 24

SP - 247

EP - 260

JO - Child Neuropsychology

JF - Child Neuropsychology

SN - 0929-7049

IS - 2

ER -