Reducing Subjectivity in Rubric-Based Assessment Through an Adaptive Weighted Penalty Model: A Computational Approach to Fair and Consistent Evaluation

Authors

Mohamad Irwan Pandapotan Harahap

Fakulti Kejuruteraan Awam, UiTM Cawangan Pulau Pinang (Malaysia)

Article Information

DOI: 10.47772/IJRISS.2026.102100216

Subject Category: Education

Volume/Issue: 10/21 | Page No: 2689-2697

Publication Timeline

Submitted: 2026-09-03

Accepted: 2026-09-08

Published: 2026-10-24

Abstract

Rubric-based assessment is widely used in higher education to evaluate student performance against predefined criteria. However, conventional rubric scoring remains susceptible to assessor subjectivity, inconsistent interpretation of performance levels, and variations in scoring decisions. This paper presents an Adaptive Weighted Penalty Model (AWPM) implemented through a computational assessment system to improve fairness, consistency, and transparency in rubric-based evaluation. The proposed approach converts qualitative assessor judgements into structured numerical scores by applying adaptive penalty values according to the degree of deviation from expected performance. The system integrates rubric configuration, assisted score entry, automated computation, and structured reporting within a unified assessment workflow. By maintaining academic judgement while standardising the computational treatment of assessment decisions, the approach has the potential to reduce scoring variability and improve the traceability of assessment outcomes. The proposed model is applicable to courses involving rubric-based evaluation, including projects, presentations, practical work, and other performance-based assessments. Its spreadsheet-based implementation also provides a practical and accessible basis for adoption across different educational settings without requiring specialised software infrastructure. The study contributes a structured computational approach to addressing persistent concerns regarding fairness and consistency in rubric-based assessment.

Keywords

Rubric-based Assessment, Adaptive Weighted Penalty, Assessment Fairness, Assessment Consistency, Computational Assessment

Downloads

References

1. Arslan Mancar, S., & Gülleroğlu, H. D. (2022). Comparison of inter-rater reliability techniques in performance-based assessment. International Journal of Assessment Tools in Education, 9(2), 515–533. [Google Scholar] [Crossref]

2. Banihashem, S. K., Gašević, D., & Noroozi, O. (2025). A critical review of using learning analytics for formative assessment: Progress, pitfalls and path forward. Journal of Computer Assisted Learning, 41(3), e70056. https://doi.org/10.1111/jcal.70056 [Google Scholar] [Crossref]

3. Castelblanco, G., Cruz-Castro, L., & Yang, Z. (2024). Performance of a large-language model in scoring construction management capstone design projects. Computer Applications in Engineering Education, 32(6), e22796. https://doi.org/10.1002/cae.22796 [Google Scholar] [Crossref]

4. Fernández-Sánchez, A., Lorenzo-Castiñeiras, J. J., & Sánchez-Bello, A. (2025). Navigating the future of pedagogy: The integration of AI tools in developing educational assessment rubrics. European Journal of Education, 60, e12826. https://doi.org/10.1111/ejed.12826 [Google Scholar] [Crossref]

5. Flodén, J. (2025). Grading exams using large language models: A comparison between human and AI grading of exams in higher education using ChatGPT. British Educational Research Journal, 51(1), 201–224. https://doi.org/10.1002/berj.4069 [Google Scholar] [Crossref]

6. Goertzen, B. J., & Klaus, K. (2023). Is it actually reliable? Examining statistical methods for inter-rater reliability of a rubric in graduate education. Research & Practice in Assessment, 18(2), 31–41. [Google Scholar] [Crossref]

7. Großmann, L., & Krüger, D. (2024). Assessing the quality of science teachers' lesson plans: Evaluation and application of a novel instrument. Science Education, 108(1), 153–189. https://doi.org/10.1002/sce.21832 [Google Scholar] [Crossref]

8. Lin, Z., Yan, H., & Zhao, L. (2024). Exploring an effective automated grading model with reliability detection for large-scale online peer assessment. Journal of Computer Assisted Learning, 40(4), 1535–1551. https://doi.org/10.1111/jcal.12970 [Google Scholar] [Crossref]

9. Nalbantoğlu Yılmaz, F. (2024). Comparing the reliability of performance task scores obtained from rating scale and analytic rubric using the generalizability theory. Studies in Educational Evaluation, 83, 101413. https://doi.org/10.1016/j.stueduc.2024.101413 [Google Scholar] [Crossref]

10. Xiong, Y., Schunn, C. D., & Wu, Y. (2023). What predicts variation in reliability and validity of online peer assessment? A large-scale cross-context study. Journal of Computer Assisted Learning, 39(6), 2004–2024. https://doi.org/10.1111/jcal.12861 [Google Scholar] [Crossref]

11. Xu, Z., & Liu, P. (2026). Assessing argument quality in L2 argumentative writing: Integrating argument elements and intellectual standards. International Journal of Applied Linguistics. Advance online publication. https://doi.org/10.1111/ijal.70219 [Google Scholar] [Crossref]

Metrics

Views & Downloads

Similar Articles