Inducing score reliability from previous reports: An examination of life satisfaction studies

Matt Vassar, Jason W. Ridge, Aaron D. Hill

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

The sample specific nature of reliability is often overlooked in substantive research, with investigators frequently referencing reliability estimates from previous studies as the basis for presuming the score integrity for their data. The purpose of the current study was to examine this practice, known as reliability induction, across studies using a popular life satisfaction (LS) measure, the Satisfaction with Life Scale. A comprehensive literature search was conducted, yielding a final sample of 196 studies using the instrument. Fifty-two studies involving 76 samples induced reliability coefficients from other sources. These studies were coded in terms of sample characteristics and variability estimates to derive comparisons in these two areas between the induced reports and the original studies. Results suggest that none of the studies inducing reliability had sufficient justification for induction. It was also found that estimating reliability coefficients for the data in hand has increased relative to induced reports and studies omitting reliability information. Practical implications for substantive researchers are discussed and suggestions for additional research are provided.

Original languageEnglish
Pages (from-to)27-45
Number of pages19
JournalSocial Indicators Research
Volume87
Issue number1
DOIs
StatePublished - 1 May 2008

Fingerprint

Research Personnel
examination
Research
Hand
induction
satisfaction with life
Life Satisfaction
integrity
Induction

Keywords

  • Life satisfaction
  • Reliability induction
  • Satisfaction with life scale

Cite this

@article{92e68d128ecd490891c35dec427fd5db,
title = "Inducing score reliability from previous reports: An examination of life satisfaction studies",
abstract = "The sample specific nature of reliability is often overlooked in substantive research, with investigators frequently referencing reliability estimates from previous studies as the basis for presuming the score integrity for their data. The purpose of the current study was to examine this practice, known as reliability induction, across studies using a popular life satisfaction (LS) measure, the Satisfaction with Life Scale. A comprehensive literature search was conducted, yielding a final sample of 196 studies using the instrument. Fifty-two studies involving 76 samples induced reliability coefficients from other sources. These studies were coded in terms of sample characteristics and variability estimates to derive comparisons in these two areas between the induced reports and the original studies. Results suggest that none of the studies inducing reliability had sufficient justification for induction. It was also found that estimating reliability coefficients for the data in hand has increased relative to induced reports and studies omitting reliability information. Practical implications for substantive researchers are discussed and suggestions for additional research are provided.",
keywords = "Life satisfaction, Reliability induction, Satisfaction with life scale",
author = "Matt Vassar and Ridge, {Jason W.} and Hill, {Aaron D.}",
year = "2008",
month = "5",
day = "1",
doi = "10.1007/s11205-007-9157-8",
language = "English",
volume = "87",
pages = "27--45",
journal = "Social Indicators Research",
issn = "0303-8300",
publisher = "Springer Netherlands",
number = "1",

}

Inducing score reliability from previous reports : An examination of life satisfaction studies. / Vassar, Matt; Ridge, Jason W.; Hill, Aaron D.

In: Social Indicators Research, Vol. 87, No. 1, 01.05.2008, p. 27-45.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Inducing score reliability from previous reports

T2 - An examination of life satisfaction studies

AU - Vassar, Matt

AU - Ridge, Jason W.

AU - Hill, Aaron D.

PY - 2008/5/1

Y1 - 2008/5/1

N2 - The sample specific nature of reliability is often overlooked in substantive research, with investigators frequently referencing reliability estimates from previous studies as the basis for presuming the score integrity for their data. The purpose of the current study was to examine this practice, known as reliability induction, across studies using a popular life satisfaction (LS) measure, the Satisfaction with Life Scale. A comprehensive literature search was conducted, yielding a final sample of 196 studies using the instrument. Fifty-two studies involving 76 samples induced reliability coefficients from other sources. These studies were coded in terms of sample characteristics and variability estimates to derive comparisons in these two areas between the induced reports and the original studies. Results suggest that none of the studies inducing reliability had sufficient justification for induction. It was also found that estimating reliability coefficients for the data in hand has increased relative to induced reports and studies omitting reliability information. Practical implications for substantive researchers are discussed and suggestions for additional research are provided.

AB - The sample specific nature of reliability is often overlooked in substantive research, with investigators frequently referencing reliability estimates from previous studies as the basis for presuming the score integrity for their data. The purpose of the current study was to examine this practice, known as reliability induction, across studies using a popular life satisfaction (LS) measure, the Satisfaction with Life Scale. A comprehensive literature search was conducted, yielding a final sample of 196 studies using the instrument. Fifty-two studies involving 76 samples induced reliability coefficients from other sources. These studies were coded in terms of sample characteristics and variability estimates to derive comparisons in these two areas between the induced reports and the original studies. Results suggest that none of the studies inducing reliability had sufficient justification for induction. It was also found that estimating reliability coefficients for the data in hand has increased relative to induced reports and studies omitting reliability information. Practical implications for substantive researchers are discussed and suggestions for additional research are provided.

KW - Life satisfaction

KW - Reliability induction

KW - Satisfaction with life scale

UR - http://www.scopus.com/inward/record.url?scp=57749133035&partnerID=8YFLogxK

U2 - 10.1007/s11205-007-9157-8

DO - 10.1007/s11205-007-9157-8

M3 - Article

AN - SCOPUS:57749133035

VL - 87

SP - 27

EP - 45

JO - Social Indicators Research

JF - Social Indicators Research

SN - 0303-8300

IS - 1

ER -