Evaluating Course Performance and Student Perceptions through Direct and Indirect Assessment: A Study of the Information Technology and Information Systems I Course
Authors
School of Educational Studies, Mongolian National University of Education, Ulaanbaatar, Mongolia|Etugen University, Ulaanbaatar, Mongolia (Mongolia)
Etugen University, Ulaanbaatar, Mongolia (Mongolia)
Etugen University, Ulaanbaatar, Mongolia (Mongolia)
School of Educational Studies, Mongolian National University of Education, Ulaanbaatar, Mongolia (Mongolia)
Article Information
DOI: 10.47772/IJRISS.2026.100900701
Subject Category: Education
Volume/Issue: 10/9 | Page No: 10130-10150
Publication Timeline
Submitted: 2026-10-01
Accepted: 2026-10-06
Published: 2026-10-21
Abstract
This study evaluated course performance and student perceptions in the Information Technology and Information Systems I course at Etugen University, Mongolia, using direct and indirect assessment evidence. The quantitative descriptive study drew on a course assessment summary representing 109 first-year undergraduate dentistry students during the fall semester of the 2025–2026 academic year. Direct evidence comprised reported scores for seminar tasks, typing performance, a course test, an independent assignment, and the end-of-course examination. Attendance was treated separately as an indicator of participation. Indirect evidence consisted of aggregate questionnaire summaries, with 70 responses to the skills self-assessment and teaching practices sections and 66 responses to the course assessment section. The two sources were examined descriptively to identify priorities for course improvement. Mean scores for the independent assignment and seminar tasks represented higher percentages of their maximum scores than those for the course test and end-of-course examination. These differences were interpreted cautiously because task demands and assessment conditions varied. Students generally reported favorable perceptions of their skills and course experiences. The proportion of favorable self-ratings was lowest for using Excel functions (72.9%), while 45.7% selected Excel for further practice. Group work and consultation outside class received favorable ratings of 52.9% and 65.7%, respectively. Favorable ratings for the selected assessment aspects ranged from 86.4% to 90.9%. Individual questionnaire responses could not be linked to performance records, and criterion-level rubric scores were unavailable. The findings suggest reviewing Excel practice, group activities, consultation access, and explanations of assessment weights. Direct and indirect assessment offered complementary perspectives, although student perceptions did not establish demonstrated proficiency and the descriptive design did not support causal conclusions
Keywords
direct assessment, indirect assessment, course evaluation, rubric-based assessment, student perceptions
Downloads
References
1. Abd Latiff, Z. I., M. Zin, N. A., Mohd Atan, F., Ismail, N. A., & Abu Bakar, Z. (2025). Programme outcome measurement through triangulated evidence: Direct attainments and indirect assessment in a Data Communication & Network course. International Journal of Research and Innovation in Social Science, 9(9), 9510–9517. https://doi.org/10.47772/IJRISS.2025.909000783 [Google Scholar] [Crossref]
2. Andrade, H. L. (2019). A critical review of research on student self-assessment. Frontiers in Education, 4, Article 87. https://doi.org/10.3389/feduc.2019.00087 [Google Scholar] [Crossref]
3. Andrade, H., & Du, Y. (2005). Student perspectives on rubric-referenced assessment. Practical Assessment, Research & Evaluation, 10(3), 1–11. https://doi.org/10.7275/g367-ye94 [Google Scholar] [Crossref]
4. Banta, T. W., & Palomba, C. A. (2014). Assessment essentials: Planning, implementing, and improving assessment in higher education (2nd ed.). Jossey-Bass. [Google Scholar] [Crossref]
5. Biggs, J. (1996). Enhancing teaching through constructive alignment. Higher Education, 32(3), 347–364. https://doi.org/10.1007/BF00138871 [Google Scholar] [Crossref]
6. Biggs, J., & Tang, C. (2011). Teaching for quality learning at university: What the student does (4th ed.). Open University Press. [Google Scholar] [Crossref]
7. Black, P., & Wiliam, D. (1998). Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1), 7–74. https://doi.org/10.1080/0969595980050102 [Google Scholar] [Crossref]
8. Boud, D., & Falchikov, N. (1989). Quantitative studies of student self-assessment in higher education: A critical analysis of findings. Higher Education, 18(5), 529–549. https://doi.org/10.1007/BF00138746 [Google Scholar] [Crossref]
9. Boud, D., & Soler, R. (2016). Sustainable assessment revisited. Assessment & Evaluation in Higher Education, 41(3), 400–413. https://doi.org/10.1080/02602938.2015.1018133 [Google Scholar] [Crossref]
10. Brookhart, S. M. (2018). Appropriate criteria: Key to effective rubrics. Frontiers in Education, 3, Article 22. https://doi.org/10.3389/feduc.2018.00022 [Google Scholar] [Crossref]
11. Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. [Google Scholar] [Crossref]
12. https://doi.org/10.1080/02602938.2018.1463354 [Google Scholar] [Crossref]
13. Constantinou, C., & Wijnen-Meijer, M. (2022). Student evaluations of teaching and the development of a comprehensive measure of teaching effectiveness for medical schools. BMC Medical Education, 22(1), Article 113. https://doi.org/10.1186/s12909-022-03148-6 [Google Scholar] [Crossref]
14. Deslauriers, L., McCarty, L. S., Miller, K., Callaghan, K., & Kestin, G. (2019). Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom. Proceedings of the National Academy of Sciences, 116(39), 19251–19257. https://doi.org/10.1073/pnas.1821936116 [Google Scholar] [Crossref]
15. Falchikov, N., & Boud, D. (1989). Student self-assessment in higher education: A meta-analysis. Review of Educational Research, 59(4), 395–430. https://doi.org/10.3102/00346543059004395 [Google Scholar] [Crossref]
16. Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81–112. https://doi.org/10.3102/003465430298487 [Google Scholar] [Crossref]
17. Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144. [Google Scholar] [Crossref]
18. https://doi.org/10.1016/j.edurev.2007.05.002 [Google Scholar] [Crossref]
19. Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218. [Google Scholar] [Crossref]
20. https://doi.org/10.1080/03075070600572090 [Google Scholar] [Crossref]
21. Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144. [Google Scholar] [Crossref]
22. https://doi.org/10.1016/j.edurev.2013.01.002 [Google Scholar] [Crossref]
23. Panadero, E., Jonsson, A., Pinedo, L., & Fernández-Castilla, B. (2023). Effects of rubrics on academic performance, self-regulated learning, and self-efficacy: A meta-analytic review. Educational Psychology Review, 35(4), Article 113. https://doi.org/10.1007/s10648-023-09823-4 [Google Scholar] [Crossref]
24. Panadero, E., & Romero, M. (2014). To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy. Assessment in Education: Principles, Policy & Practice, 21(2), 133–148. https://doi.org/10.1080/0969594X.2013.877872 [Google Scholar] [Crossref]
25. Purewsuren, B., Tsangia, U., Manaljav, Y., & Lkhagva, N. (2026). Study on the relationship between direct and indirect assessments of a software engineering program. In 2026 6th International Conference on Electrical, Computer and Energy Technologies (ICECET) (pp. 1–7). IEEE. [Google Scholar] [Crossref]
26. https://doi.org/10.1109/ICECET65726.2026.11633106 [Google Scholar] [Crossref]
27. Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435–448. https://doi.org/10.1080/02602930902862859 [Google Scholar] [Crossref]
28. Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. https://doi.org/10.1007/BF00117714 [Google Scholar] [Crossref]
29. Schellekens, L. H., Bok, H. G. J., de Jong, L. H., van der Schaaf, M. F., Kremer, W. D. J., & van der Vleuten, C. P. M. (2021). A scoping review on the notions of assessment as learning (AaL), assessment for learning (AfL), and assessment of learning (AoL). Studies in Educational Evaluation, 71, Article 101094. https://doi.org/10.1016/j.stueduc.2021.101094 [Google Scholar] [Crossref]
30. Sitzmann, T., Ely, K., Brown, K. G., & Bauer, K. N. (2010). Self-assessment of knowledge: A cognitive learning or affective measure? Academy of Management Learning & Education, 9(2), 169–191. https://doi.org/10.5465/amle.9.2.zqr169 [Google Scholar] [Crossref]
31. Spooren, P., Brockx, B., & Mortelmans, D. (2013). On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 83(4), 598–642. [Google Scholar] [Crossref]
32. https://doi.org/10.3102/0034654313496870 [Google Scholar] [Crossref]
33. Suskie, L. (2018). Assessing student learning: A common sense guide (3rd ed.). Jossey-Bass. [Google Scholar] [Crossref]
34. Tai, J., Ajjawi, R., Boud, D., Dawson, P., & Panadero, E. (2018). Developing evaluative judgement: Enabling students to make decisions about the quality of work. Higher Education, 76(3), 467–481. [Google Scholar] [Crossref]
35. https://doi.org/10.1007/s10734-017-0220-3 [Google Scholar] [Crossref]
36. Tam, M. (2014). Outcomes-based approach to quality assessment and curriculum improvement in higher education. Quality Assurance in Education, 22(2), 158–168. https://doi.org/10.1108/QAE-09-2011-0059 [Google Scholar] [Crossref]
37. Uttl, B., White, C. A., & Gonzalez, D. W. (2017). Meta-analysis of faculty’s teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Studies in Educational Evaluation, 54, 22–42. https://doi.org/10.1016/j.stueduc.2016.08.007 [Google Scholar] [Crossref]
Metrics
Views & Downloads
Similar Articles
- Assessment of the Role of Artificial Intelligence in Repositioning TVET for Economic Development in Nigeria
- Teachers’ Use of Assure Model Instructional Design on Learners’ Problem Solving Efficacy in Secondary Schools in Bungoma County, Kenya
- “E-Booksan Ang Kaalaman”: Development, Validation, and Utilization of Electronic Book in Academic Performance of Grade 9 Students in Social Studies
- Analyzing EFL University Students’ Academic Speaking Skills Through Self-Recorded Video Presentation
- Major Findings of The Study on Total Quality Management in Teachers’ Education Institutions (TEIs) In Assam – An Evaluative Study