Show simple item record

dc.contributor.authorWare, John E. Jr.
dc.contributor.authorKosinski, Mark
dc.contributor.authorBjorner, Jakob B.
dc.contributor.authorBayliss, Martha S.
dc.contributor.authorBatenhorst, Alice
dc.contributor.authorDahlof, Carl G. H.
dc.contributor.authorTepper, Stewart
dc.contributor.authorDowson, Andrew
dc.date2022-08-11T08:10:41.000
dc.date.accessioned2022-08-23T17:16:41Z
dc.date.available2022-08-23T17:16:41Z
dc.date.issued2003-12-04
dc.date.submitted2010-06-18
dc.identifier.citationQual Life Res. 2003 Dec;12(8):935-52. <a href="http://dx.doi.org/10.1023/A:1026115230284">Link to article on publisher's site</a>
dc.identifier.issn0962-9343 (Linking)
dc.identifier.doi10.1023/A:1026115230284
dc.identifier.pmid14651413
dc.identifier.urihttp://hdl.handle.net/20.500.14038/47456
dc.description.abstractOBJECTIVE: To evaluate the feasibility of computerized adaptive testing (CAT) and the reliability and validity of CAT-based estimates of headache impact scores in comparison with 'static' surveys. METHODS: Responses to the 54-item Headache Impact Test (HIT) were re-analyzed for recent headache sufferers (n = 1016) who completed telephone interviews during the National Survey of Headache Impact (NSHI). Item response theory (IRT) calibrations and the computerized dynamic health assessment (DYNHA) software were used to simulate CAT assessments by selecting the most informative items for each person and estimating impact scores according to pre-set precision standards (CAT-HIT). Results were compared with IRT estimates based on all items (total-HIT), computerized 6-item dynamic estimates (CAT-HIT-6), and a developmental version of a 'static' 6-item form (HIT-6-D). Analyses focused on: respondent burden (survey length and administration time), score distributions ('ceiling' and 'floor' effects), reliability and standard errors, and clinical validity (diagnosis, level of severity). A random sample (n = 245) was re-assessed to test responsiveness. A second study (n = 1103) compared actual CAT surveys and an improved 'static' HIT-6 among current headache sufferers sampled on the Internet. Respondents completed measures from the first study and the generic SF-8 Health Survey; some (n = 540) were re-tested on the Internet after 2 weeks. RESULTS: In the first study, simulated CAT-HIT and total-HIT scores were highly correlated (r = 0.92) without 'ceiling' or 'floor' effects and with a substantial reduction (90.8%) in respondent burden. Six of the 54 items accounted for the great majority of item administrations (3603/5028, 77.6%). CAT-HIT reliability estimates were very high (0.975-0.992) in the range where 95% of respondents scored, and relative validity (RV) coefficients were high for diagnosis (RV = 0.87) and severity (RV = 0.89); patient-level classifications were accurate 91.3% for a diagnosis of migraine. For all three criteria of change, CAT-HIT scores were more responsive than all other measures. In the second study, estimates of respondent burden, item usage, reliability and clinical validity were replicated. The test-retest reliability of CAT-HIT was 0.79 and alternate forms coefficients ranged from 0.85 to 0.91. All correlations with the generic SF-8 were negative. CONCLUSIONS: CAT-based administrations of headache impact items achieved very large reductions in respondent burden without compromising validity for purposes of patient screening or monitoring changes in headache impact over time. IRT models and CAT-based dynamic health assessments warrant testing among patients with other conditions.
dc.language.isoen_US
dc.relation<a href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=pubmed&cmd=Retrieve&list_uids=14651413&dopt=Abstract">Link to Article in PubMed</a>
dc.relation.urlhttp://dx.doi.org/10.1023/A:1026115230284
dc.subject*Computer Systems
dc.subjectConfidence Intervals
dc.subjectHeadache
dc.subjectHumans
dc.subject*Questionnaires
dc.subjectReproducibility of Results
dc.subject*Sickness Impact Profile
dc.subjectSoftware
dc.subjectBiostatistics
dc.subjectEpidemiology
dc.subjectHealth Services Research
dc.titleApplications of computerized adaptive testing (CAT) to the assessment of headache impact
dc.typeJournal Article
dc.source.journaltitleQuality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation
dc.source.volume12
dc.source.issue8
dc.identifier.legacycoverpagehttps://escholarship.umassmed.edu/qhs_pp/594
dc.identifier.contextkey1363429
html.description.abstract<p>OBJECTIVE: To evaluate the feasibility of computerized adaptive testing (CAT) and the reliability and validity of CAT-based estimates of headache impact scores in comparison with 'static' surveys.</p> <p>METHODS: Responses to the 54-item Headache Impact Test (HIT) were re-analyzed for recent headache sufferers (n = 1016) who completed telephone interviews during the National Survey of Headache Impact (NSHI). Item response theory (IRT) calibrations and the computerized dynamic health assessment (DYNHA) software were used to simulate CAT assessments by selecting the most informative items for each person and estimating impact scores according to pre-set precision standards (CAT-HIT). Results were compared with IRT estimates based on all items (total-HIT), computerized 6-item dynamic estimates (CAT-HIT-6), and a developmental version of a 'static' 6-item form (HIT-6-D). Analyses focused on: respondent burden (survey length and administration time), score distributions ('ceiling' and 'floor' effects), reliability and standard errors, and clinical validity (diagnosis, level of severity). A random sample (n = 245) was re-assessed to test responsiveness. A second study (n = 1103) compared actual CAT surveys and an improved 'static' HIT-6 among current headache sufferers sampled on the Internet. Respondents completed measures from the first study and the generic SF-8 Health Survey; some (n = 540) were re-tested on the Internet after 2 weeks.</p> <p>RESULTS: In the first study, simulated CAT-HIT and total-HIT scores were highly correlated (r = 0.92) without 'ceiling' or 'floor' effects and with a substantial reduction (90.8%) in respondent burden. Six of the 54 items accounted for the great majority of item administrations (3603/5028, 77.6%). CAT-HIT reliability estimates were very high (0.975-0.992) in the range where 95% of respondents scored, and relative validity (RV) coefficients were high for diagnosis (RV = 0.87) and severity (RV = 0.89); patient-level classifications were accurate 91.3% for a diagnosis of migraine. For all three criteria of change, CAT-HIT scores were more responsive than all other measures. In the second study, estimates of respondent burden, item usage, reliability and clinical validity were replicated. The test-retest reliability of CAT-HIT was 0.79 and alternate forms coefficients ranged from 0.85 to 0.91. All correlations with the generic SF-8 were negative.</p> <p>CONCLUSIONS: CAT-based administrations of headache impact items achieved very large reductions in respondent burden without compromising validity for purposes of patient screening or monitoring changes in headache impact over time. IRT models and CAT-based dynamic health assessments warrant testing among patients with other conditions.</p>
dc.identifier.submissionpathqhs_pp/594
dc.contributor.departmentDepartment of Quantitative Health Sciences
dc.source.pages935-52


This item appears in the following Collection(s)

Show simple item record