Reducing Subjectivity in Rubric-Based Assessment Through an Adaptive Weighted Penalty Model: A Computational Approach to Fair and Consistent Evaluation
Authors
Mohamad Irwan Pandapotan Harahap
Fakulti Kejuruteraan Awam, UiTM Cawangan Pulau Pinang (Malaysia)
Article Information
DOI: 10.47772/IJRISS.2026.102100216
Subject Category: Education
Volume/Issue: 10/21 | Page No: 2689-2697
Publication Timeline
Submitted: 2026-09-03
Accepted: 2026-09-08
Published: 2026-10-24
Abstract
Rubric-based assessment is widely used in higher education to evaluate student performance against predefined criteria. However, conventional rubric scoring remains susceptible to assessor subjectivity, inconsistent interpretation of performance levels, and variations in scoring decisions. This paper presents an Adaptive Weighted Penalty Model (AWPM) implemented through a computational assessment system to improve fairness, consistency, and transparency in rubric-based evaluation. The proposed approach converts qualitative assessor judgements into structured numerical scores by applying adaptive penalty values according to the degree of deviation from expected performance. The system integrates rubric configuration, assisted score entry, automated computation, and structured reporting within a unified assessment workflow. By maintaining academic judgement while standardising the computational treatment of assessment decisions, the approach has the potential to reduce scoring variability and improve the traceability of assessment outcomes. The proposed model is applicable to courses involving rubric-based evaluation, including projects, presentations, practical work, and other performance-based assessments. Its spreadsheet-based implementation also provides a practical and accessible basis for adoption across different educational settings without requiring specialised software infrastructure. The study contributes a structured computational approach to addressing persistent concerns regarding fairness and consistency in rubric-based assessment.
Keywords
Rubric-based Assessment, Adaptive Weighted Penalty, Assessment Fairness, Assessment Consistency, Computational Assessment
Downloads
References
1. Arslan Mancar, S., & Gülleroğlu, H. D. (2022). Comparison of inter-rater reliability techniques in performance-based assessment. International Journal of Assessment Tools in Education, 9(2), 515–533. [Google Scholar] [Crossref]
2. Banihashem, S. K., Gašević, D., & Noroozi, O. (2025). A critical review of using learning analytics for formative assessment: Progress, pitfalls and path forward. Journal of Computer Assisted Learning, 41(3), e70056. https://doi.org/10.1111/jcal.70056 [Google Scholar] [Crossref]
3. Castelblanco, G., Cruz-Castro, L., & Yang, Z. (2024). Performance of a large-language model in scoring construction management capstone design projects. Computer Applications in Engineering Education, 32(6), e22796. https://doi.org/10.1002/cae.22796 [Google Scholar] [Crossref]
4. Fernández-Sánchez, A., Lorenzo-Castiñeiras, J. J., & Sánchez-Bello, A. (2025). Navigating the future of pedagogy: The integration of AI tools in developing educational assessment rubrics. European Journal of Education, 60, e12826. https://doi.org/10.1111/ejed.12826 [Google Scholar] [Crossref]
5. Flodén, J. (2025). Grading exams using large language models: A comparison between human and AI grading of exams in higher education using ChatGPT. British Educational Research Journal, 51(1), 201–224. https://doi.org/10.1002/berj.4069 [Google Scholar] [Crossref]
6. Goertzen, B. J., & Klaus, K. (2023). Is it actually reliable? Examining statistical methods for inter-rater reliability of a rubric in graduate education. Research & Practice in Assessment, 18(2), 31–41. [Google Scholar] [Crossref]
7. Großmann, L., & Krüger, D. (2024). Assessing the quality of science teachers' lesson plans: Evaluation and application of a novel instrument. Science Education, 108(1), 153–189. https://doi.org/10.1002/sce.21832 [Google Scholar] [Crossref]
8. Lin, Z., Yan, H., & Zhao, L. (2024). Exploring an effective automated grading model with reliability detection for large-scale online peer assessment. Journal of Computer Assisted Learning, 40(4), 1535–1551. https://doi.org/10.1111/jcal.12970 [Google Scholar] [Crossref]
9. Nalbantoğlu Yılmaz, F. (2024). Comparing the reliability of performance task scores obtained from rating scale and analytic rubric using the generalizability theory. Studies in Educational Evaluation, 83, 101413. https://doi.org/10.1016/j.stueduc.2024.101413 [Google Scholar] [Crossref]
10. Xiong, Y., Schunn, C. D., & Wu, Y. (2023). What predicts variation in reliability and validity of online peer assessment? A large-scale cross-context study. Journal of Computer Assisted Learning, 39(6), 2004–2024. https://doi.org/10.1111/jcal.12861 [Google Scholar] [Crossref]
11. Xu, Z., & Liu, P. (2026). Assessing argument quality in L2 argumentative writing: Integrating argument elements and intellectual standards. International Journal of Applied Linguistics. Advance online publication. https://doi.org/10.1111/ijal.70219 [Google Scholar] [Crossref]
Metrics
Views & Downloads
Similar Articles
- Assessment of the Role of Artificial Intelligence in Repositioning TVET for Economic Development in Nigeria
- Teachers’ Use of Assure Model Instructional Design on Learners’ Problem Solving Efficacy in Secondary Schools in Bungoma County, Kenya
- “E-Booksan Ang Kaalaman”: Development, Validation, and Utilization of Electronic Book in Academic Performance of Grade 9 Students in Social Studies
- Analyzing EFL University Students’ Academic Speaking Skills Through Self-Recorded Video Presentation
- Major Findings of The Study on Total Quality Management in Teachers’ Education Institutions (TEIs) In Assam – An Evaluative Study