Replication material for: “Using Response Times to Enhance the Reliability of Political Knowledge Items: An Application to the 2015 Swiss Post-Election Survey.”

Replication material for: “Using Response Times to Enhance the Reliability of Political Knowledge Items: An Application to the 2015 Swiss Post-Election Survey.”

Authors

Lionel Marquis (University of Lausanne)

Publication year

2021

How to cite

Marquis, L. (2021). Replication material for: Using Response Times to Enhance the Reliability of Political Knowledge Items: An Application to the 2015 Swiss Post-Election Survey. FORS - Swiss Centre of Expertise in the Social Sciences. https://doi.org/10.25597/bwc6-bq54

Publisher

FORS - Swiss Centre of Expertise in the Social Sciences

Abstract

In this article, I consider the problem of "cheating" in political knowledge tests. This problem has been made more pressing by the transition of many surveys to online interviewing, opening up the possibility of looking up the correct answers on the internet. Several methods have been proposed to deal with cheating ex-ante, including self-reports of cheating, control for internet browsing, or time limits. Against this background, “response times” (RTs, i.e., the time taken by respondents to answer a survey question) suggest themselves as a post-hoc, unobtrusive means of detecting cheating. In this paper, I propose a procedure for measuring individual-specific and item-specific RTs, which are then used to identify unusually long but correct answers to knowledge questions as potential cases of cheating. I apply this procedure to the post-electoral survey for the 2015 Swiss national elections. My analysis suggests that extremely slow responses to two out of four questions are definitely suspicious. Accordingly, I propose a method for “correcting” individual knowledge scores and examine its convergent and predictive validity. Based on the finding that a simple revised scale of political knowledge has greater validity than the original additive scale, I conclude that the problem of cheating can be alleviated by using the RT method, which is again summarized in the conclusion to ensure its applicability in empirical research.

Keywords

political knowledge
cheating
response times
political knowledge
political survey

Description of the material

Spss data and syntax files. All necessary information is included in the syntax file.

Geolocation

Switzerland

Remarks

Please note that the data and syntax are only distributed in SPSS format.

Publication

No. 1