Extending the Cognitive Aspects of Survey Methodology (CASM): Mental State, Social Control, and Literacy in Online and Offline Surveys

Authors

Budi Suharjo

School of Data Science, Mathematics and Informatics, IPB University Jl. Meranti, Kampus IPB Dramaga, Bogor, West Java, 16680 (Indonesia)

Article Information

DOI: 10.51244/IJRSI.2026.1306000526

Subject Category: Cognitive Psychology

Volume/Issue: 13/6 | Page No: 6979-6995

Publication Timeline

Submitted: 2026-07-05

Accepted: 2026-07-10

Published: 2026-07-23

Abstract

The rapid diffusion of online surveys has transformed data collection practices in social, business, and public policy research, often positioning self-administered online surveys as substitutes for interviewer-assisted offline surveys. However, operational efficiency does not automatically translate into higher data validity. From a data-centered perspective, data validity emerges from the interaction among the questionnaire, respondents, and enumerators. In offline surveys, enumerators act as cognitive and social mediators by ensuring comprehension, providing clarification, and maintaining social control—functions that are structurally absent in online surveys. Consequently, online surveys transfer the burden of comprehension and response quality control entirely to respondents, making measurement outcomes highly dependent on respondents’ mental state and literacy dependence, while increasing the likelihood of satisficing under low-accountability conditions. Building on the Cognitive Aspects of Survey Methodology (CASM), this article argues that classical CASM implicitly assumes relatively homogeneous measurement conditions across survey modes. To address this limitation, the study proposes an enrichment of CASM by explicitly incorporating respondent mental state, literacy dependence, and social control at the comprehension stage as key structural distinctions between online and offline survey environments, with direct implications for data validity.

Keywords

Online surveys; Survey methodology; CASM; Data validity; Mode effects

Downloads

References

1. Arthur, W., Jr., Hagen, E., & George, F. (2021). The lazy or dishonest respondent: Detection and prevention. Annual Review of Organizational Psychology and Organizational Behavior, 8, 105–137. https://doi.org/10.1146/annurev-orgpsych-012420-055324 [Google Scholar] [Crossref]

2. Couper, M. P. (2008). Designing effective web surveys. Cambridge University Press. [Google Scholar] [Crossref]

3. Couper, M. P., Tourangeau, R., Conrad, F. G., & Singer, E. (2017). Evaluating the effectiveness of visual analog scales: A web experiment. Public Opinion Quarterly, 81(1), 1–24. https://doi.org/10.1093/poq/nfw040 [Google Scholar] [Crossref]

4. Curran, P. G. (2016). Methods for the detection of carelessly invalid responses in survey data. Journal of Experimental Social Psychology, 66, 4–19. https://doi.org/10.1016/j.jesp.2015.07.006 [Google Scholar] [Crossref]

5. Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method (4th ed.). Wiley. [Google Scholar] [Crossref]

6. Galesic, M., & Bosnjak, M. (2009). Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly, 73(2), 349–360. https://doi.org/10.1093/poq/nfp031 [Google Scholar] [Crossref]

7. Gottfried, J. (2024). Practices in data-quality evaluation: A large-scale review of online survey studies published in 2022. Advances in Methods and Practices in Psychological Science, 7(2). https://doi.org/10.1177/25152459241236414 [Google Scholar] [Crossref]

8. Groves, R. M., Fowler, F. J., Jr., Couper, M. P., Lepkowski, J. M., Singer, E., & Tourangeau, R. (2009). Survey methodology (2nd ed.). Wiley. [Google Scholar] [Crossref]

9. Huang, J. L., Liu, M., & Bowling, N. A. (2015). Insufficient effort responding: Examining an insidious confound in survey data. Journal of Applied Psychology, 100(3), 828–845. https://doi.org/10.1037/a0038510 [Google Scholar] [Crossref]

10. Kam, C. C. S. (2019). Careless responding threatens factorial analytic results and construct validity of personality measures. Frontiers in Psychology, 10, Article 1258. https://doi.org/10.3389/fpsyg.2019.01258 [Google Scholar] [Crossref]

11. Kreuter, F., Presser, S., & Tourangeau, R. (2008). Social desirability bias in CATI, IVR, and web surveys: The effects of mode and question sensitivity. Public Opinion Quarterly, 72(5), 847–865. https://doi.org/10.1093/poq/nfn063 [Google Scholar] [Crossref]

12. Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5(3), 213–236. https://doi.org/10.1002/acp.2350050305 [Google Scholar] [Crossref]

13. Malhotra, N. K. (2008). Completion time and response order effects in web surveys. Public Opinion Quarterly, 72(5), 914–934. [Google Scholar] [Crossref]

14. Margolis, M. F., & Sances, M. W. (2024). Measuring attentiveness in self-administered surveys. Public Opinion Quarterly, 88(1), 214–241. https://doi.org/10.1093/poq/nfae004 [Google Scholar] [Crossref]

15. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances. American Psychologist, 50(9), 741–749. https://doi.org/10.1037/0003-066X.50.9.741 [Google Scholar] [Crossref]

16. Rao, J. N. K., & Lohr, S. L. (2025). Trends and directions in sample survey theory and methods. Survey Methodology, 51(1), 81–113. [Google Scholar] [Crossref]

17. Schles, R. A., & Deheck, C. M. (2026). Identifying and mitigating the influence of invalid responses in online surveys: A longitudinal case study. Quality & Quantity, 60, 1903–1921. https://doi.org/10.1007/s11135-025-02333-1 [Google Scholar] [Crossref]

18. Schwarz, N., & Oyserman, D. (2001). Asking questions about behavior: Cognition, communication, and questionnaire construction. American Journal of Evaluation, 22(2), 127–160. https://doi.org/10.1177/109821400102200202 [Google Scholar] [Crossref]

19. Stantcheva, S. (2023). How to run surveys: A guide to creating your own identifying variation and revealing the invisible. Annual Review of Economics, 15, 205–234. https://doi.org/10.1146/annurev-economics-091622-010157 [Google Scholar] [Crossref]

20. Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133(5), 859–883. https://doi.org/10.1037/0033-2909.133.5.859 [Google Scholar] [Crossref]

21. Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response. Cambridge University Press. [Google Scholar] [Crossref]

22. Ward, M. K., & Meade, A. W. (2023). Dealing with careless responding in survey data: Prevention, identification, and recommended best practices. Annual Review of Psychology, 74, 577–596. https://doi.org/10.1146/annurev-psych-040422-045007 [Google Scholar] [Crossref]

23. Welz, M., & Alfons, A. (2023). When respondents do not care anymore: Identifying the onset of careless responding. Behavior Research Methods. Advance online publication. https://doi.org/10.3758/s13428-023-02233-4 [Google Scholar] [Crossref]

24. Willis, G. B. (2004). Cognitive interviewing revisited: A useful technique, in theory? In S. Presser, J. M. Rothgeb, M. P. Couper, J. T. Lessler, E. Martin, J. Martin, & E. Singer (Eds.), Methods for testing and evaluating survey questionnaires (pp. 23–43). John Wiley & Sons. https://doi.org/10.1002/0471654728.ch2 [Google Scholar] [Crossref]

Metrics

Views & Downloads

Similar Articles