This title appears in the Scientific Report :
2020
Please use the identifier:
http://hdl.handle.net/2128/24692 in citations.
Please use the identifier: http://dx.doi.org/10.18148/SRM/2020.V14I1.7374 in citations.
Attention check items and instructions in online surveys with incentivized and non-incentivized samples: Boon or bane for data quality?
Attention check items and instructions in online surveys with incentivized and non-incentivized samples: Boon or bane for data quality?
In this paper, we examine rates of careless responding and reactions towards detection methods (i.e., attention check item and instruction) in an experimental setting based on two different samples. First, we use a quota sample (with monetary incentive), a central data source for internet-based surv...
Saved in:
Personal Name(s): | Shamon, Hawal (Corresponding author) |
---|---|
Berning, Carl Clemens | |
Contributing Institute: |
Systemforschung und Technologische Entwicklung; IEK-STE |
Published in: | Survey research methods, 14 (2020) 1, S. 55-77 |
Imprint: |
Konstanz
Survey Research Methods
2020
|
DOI: |
10.18148/SRM/2020.V14I1.7374 |
Document Type: |
Journal Article |
Research Program: |
Assessment of Energy Systems – Addressing Issues of Energy Efficiency and Energy Security |
Link: |
OpenAccess OpenAccess |
Publikationsportal JuSER |
Please use the identifier: http://dx.doi.org/10.18148/SRM/2020.V14I1.7374 in citations.
In this paper, we examine rates of careless responding and reactions towards detection methods (i.e., attention check item and instruction) in an experimental setting based on two different samples. First, we use a quota sample (with monetary incentive), a central data source for internet-based surveys in sociological and political research. Second, we include a voluntary opt-in panel (without monetary incentive) well suited to conduct survey experiments (e.g., factorial surveys). Respondents’ reactions towards the detection items are analyzed by objective, non-reactive indicators (i.e., break-off, item nonresponse, and measurement quality), and two self-report scales. Our reaction analyses reveal that the detection methods that we applied are not only well suited to identify careless respondents but also exert a motivational rather than demotivating influence on respondents’ answer behavior and, hence, contribute to data quality. |