Eye-tracking methodology: exploring the processing of question formats in web surveys |
| |
| Authors: | Jan Karem Höhne |
| |
| Institution: | 1. Collaborative Research Center 884 “Political Economy of Reforms”, University of Mannheim, Mannheim, Germany;2. Research and Expertise Centre for Survey Methodology, Universitat Pompeu Fabra, Barcelona, Spain |
| |
| Abstract: | In social research, the use of agree/disagree (A/D) questions is a popular method for measuring attitudes. Research has shown that A/D questions require complex cognitive processing and are susceptible to response bias. Thus, some researchers recommend the use of item-specific (IS) questions. This study examines the processing of A/D and IS questions, using eye-tracking methodology. By recording respondents’ eye movements, how respondents process survey questions can be evaluated. The results reveal that IS questions cause more and longer fixations. However, this only applies to the response categories. There are no differences regarding the question stems. Altogether, it seems that IS response categories trigger deeper cognitive processing than A/D response categories. |
| |
| Keywords: | Agree/disagree questions item-specific questions lab experiment web surveys rating scales survey methodology |
|
|
