Question Evaluation Methods (eBook)

JENNIFER MADANS, PhD, is Associate Director for Science at the National Center for Health Statistics (NCHS). She has published numerous papers in the areas of health status measurement, chronic disease epidemiology, and aging. KRISTEN MILLER, PhD, is Director of the Question Design Research Laboratory at the NCHS. She currently oversees the question evaluation research program and designs and implements research projects on data quality and comparability in the health sciences. AARON MAITLAND, MS, is Statistician at the Question Design Research Laboratory at the NCHS, where he is the administrator of Q-Bank, the agency's online database of question evaluation reports for Federal surveys. GORDON WILLIS, PhD, is a Cognitive Psychologist at the Applied Research Program in the Division of Cancer Control and Population Sciences at the National Cancer Institute. Dr. Willis has more than twenty years of experience in planning, conducting, and reporting of all phases of cognitive laboratory research.

Contributors ix

Preface xi

1 Introduction 1

Jennifer Madans, Kristen Miller, Aaron Maitland, and Gordon
Willis

I BEHAVIOR CODING 5

2 Coding the Behavior of Interviewers and Respondents to
Evaluate Survey Questions 7

Floyd J. Fowler, Jr.

3 Response 1 to Fowler's Chapter: Coding the Behavior
of Interviewers and Respondents to Evaluate Survey Questions
23

Nora Cate Schaeffer and Jennifer Dykema

4 Response 2 to Fowler's Chapter: Coding the Behavior
of Interviewers and Respondents to Evaluate Survey Questions
41

Alisú Schoua-Glusberg

II COGNITIVE INTERVIEWING 49

5 Cognitive Interviewing 51

Kristen Miller

6 Response 1 to Miller's Chapter: Cognitive
Interviewing 77

Gordon Willis

7 Response 2 to Miller's Chapter: Cognitive
Interviewing 93

Frederick G. Conrad

III ITEM RESPONSE THEORY 103

8 Applying Item Response Theory for Questionnaire Evaluation
105

Bryce B. Reeve

9 Response 1 to Reeve's Chapter: Applying Item Response
Theory for Questionnaire Evaluation 125

Ron D. Hays

10 Response 2 to Reeve's Chapter: Applying Item
Response Theory for Questionnaire Evaluation 137

Clyde Tucker, Brian Meekins, Jennifer Edgar, and Paul P.
Biemer

IV LATENT CLASS ANALYSIS 151

11 Some Issues in the Application of Latent Class Models for
Questionnaire Design 153

Paul P. Biemer and Marcus Berzofsky

12 Response 1 to Biemer and Berzofsky's Chapter: Some
Issues in the Application of Latent Class Models for Questionnaire
Design 187

Frauke Kreuter

13 Response 2 to Biemer and Berzofsky's Chapter: Some
Issues in the Application of Latent Class Models for Questionnaire
Design 199

Janet A. Harkness and Timothy P. Johnson

V SPLIT-SAMPLE EXPERIMENTS 213

14 Experiments for Evaluating Survey Questions 215

Jon A. Krosnick

15 Response 1 to Krosnick's Chapter: Experiments for
Evaluating Survey Questions 239

Johnny Blair

16 Response 2 to Krosnick's Chapter: Experiments for
Evaluating Survey Questions 253

Theresa DeMaio and Stephanie Willson

VI MULTITRAIT-MULTIMETHOD EXPERIMENTS 263

17 Evaluating the Reliability and Validity of Survey
Interview Data Using the MTMM Approach 265

Duane F. Alwin

18 Response to Alwin's Chapter: Evaluating the
Reliability and Validity of Survey Interview Data Using the MTMM
Approach 295

Peter Ph. Mohler

VII FIELD-BASED DATA METHODS 319

19 Using Field Tests to Evaluate Federal Statistical Survey
Questionnaires 321

Brian A. Harris-Kojetin and James M. Dahlhamer

Index 345