A Critical Review of Artificial Intelligence for Assessment: From Promise to Practice

The incorporation of Artificial Intelligence (AI) into evaluation processes in education, recruitment, and research has significantly accelerated, propelled by advancements in large language models (LLMs) and machine learning. This critical review amalgamates evidence from systematic reviews, empirical studies, and ethical frameworks published from 2018 to 2026 to assess AI's role in evaluation. The review looks at the technical state of AI-based assessment, talks about the problems of algorithmic bias and fairness, points out the epistemological limitations of machine scoring, talks about the gaps in regulatory and ethical accountability, and thinks about the paradox of using AI to find AI-generated content. Our analysis finds that while AI can grade consistently and quickly, the evidence for its accuracy is shaky. Most performance tests for AI (benchmarks) are not statistically sound, efforts to reduce bias are fragmented, and current quality standards fail to address AI's unique failures. Bias mitigation efforts are disjointed, and current assessment quality criteria do not adequately address AI's distinct failures.

artificial intelligence, assessment, algorithmic bias, automated grading, large language models, ethical frameworks, human oversight

1. Ahmed, S., Awan, D., Adil, M., & Ahmad, A. (2025). Ethics and Transparency in AI, Transparency, and Accountability in Higher Education. Social Science Review Archives, 3(4), 2729-2741. [Google Scholar] [Crossref]

2. Alaparthi, S., & Mishra, M. (2020). Bidirectional Encoder Representations from Transformers (BERT): A sentiment analysis odyssey. arXiv preprint arXiv:2007.01127. [Google Scholar] [Crossref]

3. Ayaan, A., & Ng, K. W. (2025). Automated grading using natural language processing and semantic analysis. MethodsX, 14, 103395. [Google Scholar] [Crossref]

4. Bandara, R. J., Biswas, K., Akter, S., Shafique, S., & Rahman, M. (2025). Addressing algorithmic bias in AI‐driven HRM systems: Implications for strategic HRM effectiveness. Human Resource Management Journal, 35(4), 1047-1063. [Google Scholar] [Crossref]

5. Bonthu, S., Rama Sree, S., & Krishna Prasad, M. H. M. (2021). Automated short answer grading using deep learning: A survey. In International cross-domain conference for machine learning and knowledge extraction (pp. 61-78). Cham: Springer International Publishing. [Google Scholar] [Crossref]

6. Burnell, R., Schellaert, W., Burden, J., Ullman, T. D., Martinez-Plumed, F., Tenenbaum, J. B., ... & Hernandez-Orallo, J. (2023). Rethink reporting of evaluation results in AI. Science, 380(6641), 136-138. [Google Scholar] [Crossref]

7. Chaka, C. (2024). Reviewing the performance of AI detection tools in differentiating between AI-generated and human-written texts: A literature and integrative hybrid review. Journal of Applied Learning & Teaching, 7(1), 115-126. [Google Scholar] [Crossref]

8. Chinta, S. V., Wang, Z., Yin, Z., Hoang, N., Gonzalez, M., Quy, T. L., & Zhang, W. (2024). FairAIED: Navigating fairness, bias, and ethics in educational AI applications. arXiv preprint arXiv:2407.18745. [Google Scholar] [Crossref]

9. Cheong, M. L. (2025). ChatGPT’s performance evaluation in spreadsheets modeling to inform assessments redesign. Journal of Computer Assisted Learning, 41(3), 1-17. [Google Scholar] [Crossref]

10. Emirtekin, E. (2025). Large language model-powered automated assessment: a systematic review. Applied Sciences, 15(10), 5683. [Google Scholar] [Crossref]

11. Flemyng, E., Noel-Storr, A., Macura, B., Gartlehner, G., Thomas, J., Meerpohl, J. J., ... & Grainger, M. (2025). Position statement on artificial intelligence (AI) use in evidence synthesis across Cochrane, the Campbell Collaboration, JBI, and the Collaboration for Environmental Evidence 2025. Campbell Systematic Reviews, 21(4), cl2-70074. [Google Scholar] [Crossref]

12. Freeman, J. (2025). Student Generative AI Survey 2025. Oxford: Higher Education Policy Institute. [Google Scholar] [Crossref]

13. Gnanaprakasam, J., & Lourdusamy, R. (2024). The role of AI in automating grading: Enhancing feedback and efficiency. In Artificial intelligence and education-shaping the future of learning. IntechOpen. [Google Scholar] [Crossref]

14. Hawrysz, L. (2025). Artificial Intelligence in Candidate Screening: Opportunities and Challenges. Organization & Management, Series No. 228, 203-217. [Google Scholar] [Crossref]

15. Jaturat, N., Na-Nan, K., & Hu, B. (2026). Measuring AI responsibility: A cross-country validation of a multidimensional framework. International Journal of Information Management Data Insights, 6(1), 100388. [Google Scholar] [Crossref]

16. Kuzminykh, I., Nawaz, T., Shenzhang, S., Ghita, B., Raphael, J., & Xiao, H. (2024). Personalised feedback framework for online education programmes using generative AI. arXiv preprint arXiv:2410.11904. [Google Scholar] [Crossref]

17. Najafi, F. T., Pabba, V. R., Subramanian, R., & Vidalis, S. M. (2025). AI-Assisted Grading–A Study on Efficiency and Fairness. In 2025 ASEE Southeast Conference. [Google Scholar] [Crossref]

18. Nikhil, V., Annamalai, R., & Jayapal, S. (2025). NLP-driven approaches to automated essay grading and feedback. In Adopting Artificial Intelligence Tools in Higher Education (pp. 99-117). CRC Press. [Google Scholar] [Crossref]

19. Oberhauser, H. J. (2025). Bias in Artificial Intelligence: Exploring its role in institutional discrimination and strategies for mitigation (Master's thesis, Universidade NOVA de Lisboa, Portugal). [Google Scholar] [Crossref]

20. Ramesh, D., & Sanampudi, S. K. (2022). An automated essay scoring systems: a systematic literature review. Artificial Intelligence Review, 55(3), 2495-2527. [Google Scholar] [Crossref]

21. Simoni, J., Urtubia-Fernandez, J., Mengual, E., Simoni, D. A., Royo, M., Egaña-Yin, D., ... & Pereira, J. L. (2025). Artificial intelligence in undergraduate medical education: an updated scoping review. BMC Medical Education, 25(1), 1609. [Google Scholar] [Crossref]

22. Zhao, X., Lu, J., Deng, C., Zheng, C., Wang, J., Chowdhury, T., ... & Gu, Q. (2023). Beyond one-model-fits-all: A survey of domain specialization for large language models. arXiv preprint arXiv, 2305. [Google Scholar] [Crossref]

• The Role of Artificial Intelligence in Revolutionizing Library Services in Nairobi: Ethical Implications and Future Trends in User Interaction
• ESPYREAL: A Mobile Based Multi-Currency Identifier for Visually Impaired Individuals Using Convolutional Neural Network
• Comparative Analysis of AI-Driven IoT-Based Smart Agriculture Platforms with Blockchain-Enabled Marketplaces
• AI-Based Dish Recommender System for Reducing Fruit Waste through Spoilage Detection and Ripeness Assessment
• SEA-TALK: An AI-Powered Voice Translator and Southeast Asian Dialects Recognition