The Reliability of Self-Report in Clinical Psychology: Evidence from Outpatient Clinics in Malawi

Self-report measures are a common tool in clinical psychology for understanding a person’s mental health symptoms and deciding on treatment plans. But people often wonder how reliable these measures really are, especially when used in different healthcare settings. This particular study took a closer look at the reliability of some frequently used self-report measures. The researcher gathered information from 60 participants who were visiting outpatient mental health clinics in Malawi. These participants filled out standard measures about depression, anxiety, and stress, and then did the same set of questionnaires again two weeks later to see if their answers stayed consistent (this is called test-retest reliability). The researcher also checked how well the questions within each questionnaire went together (internal consistency) using a measure called Cronbach’s alpha, and looked at the stability of the results over time using something called intra-class correlation coefficients (ICCs). The results showed that the questionnaires were quite consistent internally across all of them (alpha scores were between .82 and .91). However, the consistency over the two weeks varied depending on what was being measured. The anxiety measures seemed to be the least stable (ICC = .68). When the researcher talked to the clinicians involved, discovered that there were often noticeable differences between what the self-report questionnaires suggested and the clinicians own professional opinions, particularly for clients with lower levels of literacy or those dealing with cultural stigma around mental health. These results highlight how important it is to adapt assessments based on the specific context and to include other types of evaluations, like those done by clinicians, to make diagnoses more accurate. The study goes on to discuss what these findings mean for how clinicians work and for developing better assessment tools in the future.

Self-report measures, Clinical psychology, Reliability, Internal consistency

1. Anufriyeva, V., Pavlova, M., Stepurko, T., & Groot, W. (2021). Validity and reliability of self-reported satisfaction with healthcare as a measure of quality: A systematic literature review. International Journal for Quality in Health Care, 33(1). [Google Scholar] [Crossref]

2. Dinerstein, C. (2019). Measuring the Reliability of Self-Reported Behavior. American Council on Science and Health. [Google Scholar] [Crossref]

3. Flisher, A. J., Kaaya, S. F., Butau, T., Kilonzo, G. K., Mwambo, J., Lombard, C. J., & Muller, M. (2005). Test-retest reliability of self-reported adolescent addictive and other risk behaviours in Tanzania, South Africa, and Zimbabwe. African Index Medicus, 4, 1–12 [Google Scholar] [Crossref]

4. Låver, J., McAleavey, A., Valaker, I., Castonguay, L. G., & Moltu, C. (2023). Therapists’ and patients’ experiences of using patients’ self-reported data in ongoing psychotherapy processes: A systematic review and meta-analysis of qualitative studies. Psychotherapy Research, 34(3), 293–310. [Google Scholar] [Crossref]

5. Squires, J. E., Estabrooks, C. A., O'Rourke, H. M., Gustavsson, P., Newburn-Cook, C. V., & Wallin, L. (2011). A systematic review of the psychometric properties of self-report research utilization measures used in healthcare. Implementation Science, 6(83). [Google Scholar] [Crossref]

6. Weir, C. (2023). Exploring the use of self-report behavioural science questionnaires in sub-Saharan African countries. Doctoral Thesis, University of Stirling [Google Scholar] [Crossref]

7. Zimbardo, P. (n.d.). Self-Report Measures: Psychology Definition, History & Examples. [Google Scholar] [Crossref]

8. Zieff, M. R., Fourie, C., Hoogenhout, M., & Donald, K. A. (2022). Psychometric properties of the ASEBA Child Behaviour Checklist and Youth Self-Report in sub-Saharan Africa: A systematic review. Acta Neuropsychiatrica, 34(4), 167–190 [Google Scholar] [Crossref]

• A Comparative Study of Adjustment Level, Parental Income and Academic Achievement of Adolescent Girls
• Increase in STIs among Adolescents in Masvingo District
• A Correlation between SDG 4 (Quality Education) and Emotional Disposition of Teacher Educators in Hyderabad District
• Ear Piercing Behaviour and Self-Esteem among Male University Students in Nigeria
• A Study of Religiosity and Psychological Well-Being