Scientific Reasoning in Students with and Without Prior Exposure to Experiential Learning: A School-Adjusted Comparison
Authors
Prayoga Institute of Education Research, Bengaluru, Karnataka, India (India)
Prayoga Institute of Education Research, Bengaluru, Karnataka, India (India)
Article Information
DOI: 10.47772/IJRISS.2026.100900709
Subject Category: Education
Volume/Issue: 10/9 | Page No: 10249-10275
Publication Timeline
Submitted: 2026-09-27
Accepted: 2026-10-02
Published: 2026-10-21
Abstract
Experiential, hands-on science learning is now national policy in India, yet evidence on what such programmes leave behind in students' reasoning is thin. This study evaluated Kriya, a longitudinal experiential science programme that targets Piagetian reasoning operations in schools across Karnataka. We compared Grade 8 students who had taken part in Kriya during Grades 6 and 7 (n = 2,202) with newly admitted classmates who had no prior exposure (n = 1,208) in 60 secondary schools across 34 districts. Both groups took the same 22-item reasoning test in June 2026, at the start of Grade 8. The analysis used Welch's t-test, school fixed-effects regression, competency-level models, analysis of the score distribution and sensitivity analyses for differential absence. Continuing students scored higher than new admissions (40.9% vs 37.6%; d = 0.18). Within schools, the difference fell to 2.1 percentage points (0.11 SD, 95% CI [0.06, 0.17]), because about a third of the raw gap reflected school composition. Gains were clearest for classification and transitivity, smaller for seriation, conservation and inductive logic, and not detected for identity or generalisation. The advantage lay in the lower and middle parts of the score distribution rather than at the top. Continuing students were absent nearly three times as often as new admissions, and under pessimistic assumptions about absent students the unadjusted gap fell to 0.9 points. Continuing students had also sat the programme's assessments before, and this familiarity may account for part of the difference. Two years of experiential learning were therefore associated with a small and uneven advantage in reasoning, and both groups remained far from mastery. Evaluations that rely on naturally occurring comparison groups should report school-adjusted estimates, attendance-sensitivity analyses and item-level checks alongside raw differences.
Keywords
Experiential learning; Scientific reasoning; Programme evaluation; Piagetian operations
Downloads
References
1. Adey, P. (2005). Issues arising from the long-term evaluation of cognitive acceleration programs. Research in Science Education, 35(1), 3–22. https://doi.org/10.1007/s11165-004-3430-5 [Google Scholar] [Crossref]
2. Adey, P., & Shayer, M. (1990). Accelerating the development of formal thinking in middle and high school students. Journal of Research in Science Teaching, 27(3), 267–285. https://doi.org/10.1002/tea.3660270309 [Google Scholar] [Crossref]
3. Adey, P., & Shayer, M. (1994). Really raising standards: Cognitive intervention and academic achievement. Routledge. [Google Scholar] [Crossref]
4. Alfieri, L., Brooks, P. J., Aldrich, N. J., & Tenenbaum, H. R. (2011). Does discovery-based instruction enhance learning? Journal of Educational Psychology, 103(1), 1–18. https://doi.org/10.1037/a0021017 [Google Scholar] [Crossref]
5. Bailey, D., Duncan, G. J., Odgers, C. L., & Yu, W. (2017). Persistence and fadeout in the impacts of child and adolescent interventions. Journal of Research on Educational Effectiveness, 10(1), 7–39. https://doi.org/10.1080/19345747.2016.1232459 [Google Scholar] [Crossref]
6. Bailey, D. H., Duncan, G. J., Cunha, F., Foorman, B. R., & Yeager, D. S. (2020). Persistence and fade-out of educational-intervention effects: Mechanisms and potential solutions. Psychological Science in the Public Interest, 21(2), 55–97. https://doi.org/10.1177/1529100620915848 [Google Scholar] [Crossref]
7. Banerjee, A. V., Cole, S., Duflo, E., & Linden, L. (2007). Remedying education: Evidence from two randomized experiments in India. The Quarterly Journal of Economics, 122(3), 1235–1264. https://doi.org/10.1162/qjec.122.3.1235 [Google Scholar] [Crossref]
8. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289–300. https://doi.org/10.1111/j.2517-6161.1995.tb02031.x [Google Scholar] [Crossref]
9. Cameron, A. C., Gelbach, J. B., & Miller, D. L. (2008). Bootstrap-based improvements for inference with clustered errors. The Review of Economics and Statistics, 90(3), 414–427. https://doi.org/10.1162/rest.90.3.414 [Google Scholar] [Crossref]
10. Cameron, A. C., & Miller, D. L. (2015). A practitioner's guide to cluster-robust inference. Journal of Human Resources, 50(2), 317–372. https://doi.org/10.3368/jhr.50.2.317 [Google Scholar] [Crossref]
11. Cheung, A. C. K., & Slavin, R. E. (2016). How methodological features affect effect sizes in education. Educational Researcher, 45(5), 283–292. https://doi.org/10.3102/0013189X16656615 [Google Scholar] [Crossref]
12. Chi, S., Liu, X., & Wang, Z. (2021). Comparing student science performance between hands-on and traditional item types: A many-facet Rasch analysis. Studies in Educational Evaluation, 70, Article 100998. https://doi.org/10.1016/j.stueduc.2021.100998 [Google Scholar] [Crossref]
13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates. [Google Scholar] [Crossref]
14. Conn, K. M. (2017). Identifying effective education interventions in sub-Saharan Africa: A meta-analysis of impact evaluations. Review of Educational Research, 87(5), 863–898. https://doi.org/10.3102/0034654317712025 [Google Scholar] [Crossref]
15. Corning, A., Broda, M. D., Lucas, B.-L., Becker, J. D., & Bae, C. L. (2023). An inclusive school for computer science: Evaluating early impact with propensity score matching. Studies in Educational Evaluation, 79, Article 101293. https://doi.org/10.1016/j.stueduc.2023.101293 [Google Scholar] [Crossref]
16. Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41(3–4), 327–350. https://doi.org/10.1007/s10464-008-9165-0 [Google Scholar] [Crossref]
17. Ebel, R. L., & Frisbie, D. A. (1991). Essentials of educational measurement (5th ed.). Prentice Hall. [Google Scholar] [Crossref]
18. Feldt, L. S. (1965). The approximate sampling distribution of Kuder–Richardson reliability coefficient twenty. Psychometrika, 30(3), 357–370. https://doi.org/10.1007/BF02289499 [Google Scholar] [Crossref]
19. Furtak, E. M., Seidel, T., Iverson, H., & Briggs, D. C. (2012). Experimental and quasi-experimental studies of inquiry-based science teaching: A meta-analysis. Review of Educational Research, 82(3), 300–329. https://doi.org/10.3102/0034654312457206 [Google Scholar] [Crossref]
20. Gottfried, M. A. (2010). Evaluating the relationship between student attendance and achievement in urban elementary and middle schools: An instrumental variables approach. American Educational Research Journal, 47(2), 434–465. https://doi.org/10.3102/0002831209350494 [Google Scholar] [Crossref]
21. Hanley, P., Böhnke, J. R., Slavin, R., Elliott, L., & Croudace, T. (2016). Let's Think Secondary Science: Evaluation report and executive summary. Education Endowment Foundation. https://educationendowmentfoundation.org.uk/projects-and-evaluation/projects/lets-think-secondary-science [Google Scholar] [Crossref]
22. Hedges, L. V., & Hedberg, E. C. (2007). Intraclass correlation values for planning group-randomized trials in education. Educational Evaluation and Policy Analysis, 29(1), 60–87. https://doi.org/10.3102/0162373707299706 [Google Scholar] [Crossref]
23. Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2(3), 172–177. https://doi.org/10.1111/j.1750-8606.2008.00061.x [Google Scholar] [Crossref]
24. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel–Haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity (pp. 129–145). Lawrence Erlbaum Associates. [Google Scholar] [Crossref]
25. Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6(2), 65–70. [Google Scholar] [Crossref]
26. Inhelder, B., & Piaget, J. (1958). The growth of logical thinking from childhood to adolescence: An essay on the construction of formal operational structures (A. Parsons & S. Milgram, Trans.). Basic Books. [Google Scholar] [Crossref]
27. Inhelder, B., & Piaget, J. (1964). The early growth of logic in the child: Classification and seriation (E. A. Lunzer & D. Papert, Trans.). Routledge & Kegan Paul. [Google Scholar] [Crossref]
28. Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development. Prentice-Hall. [Google Scholar] [Crossref]
29. Kraft, M. A. (2020). Interpreting effect sizes of education interventions. Educational Researcher, 49(4), 241–253. https://doi.org/10.3102/0013189X20912798 [Google Scholar] [Crossref]
30. Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2(3), 151–160. https://doi.org/10.1007/BF02288391 [Google Scholar] [Crossref]
31. Lawson, A. E. (1978). The development and validation of a classroom test of formal reasoning. Journal of Research in Science Teaching, 15(1), 11–24. https://doi.org/10.1002/tea.3660150103 [Google Scholar] [Crossref]
32. Lazonder, A. W., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning: Effects of guidance. Review of Educational Research, 86(3), 681–718. https://doi.org/10.3102/0034654315627366 [Google Scholar] [Crossref]
33. Lee, D. S. (2009). Training, wages, and sample selection: Estimating sharp bounds on treatment effects. The Review of Economic Studies, 76(3), 1071–1102. https://doi.org/10.1111/j.1467-937X.2009.00536.x [Google Scholar] [Crossref]
34. McGraw, K. O., & Wong, S. P. (1992). A common language effect size statistic. Psychological Bulletin, 111(2), 361–365. https://doi.org/10.1037/0033-2909.111.2.361 [Google Scholar] [Crossref]
35. Ministry of Human Resource Development. (2020). National education policy 2020. Government of India. https://www.education.gov.in/sites/upload_files/mhrd/files/NEP_Final_English.pdf [Google Scholar] [Crossref]
36. Minner, D. D., Levy, A. J., & Century, J. (2010). Inquiry-based science instruction—what is it and does it matter? Results from a research synthesis years 1984 to 2002. Journal of Research in Science Teaching, 47(4), 474–496. https://doi.org/10.1002/tea.20347 [Google Scholar] [Crossref]
37. Muralidharan, K., Singh, A., & Ganimian, A. J. (2019). Disrupting education? Experimental evidence on technology-aided instruction in India. American Economic Review, 109(4), 1426–1460. https://doi.org/10.1257/aer.20171112 [Google Scholar] [Crossref]
38. National Council of Educational Research and Training. (2023). National curriculum framework for school education 2023. [Google Scholar] [Crossref]
39. National Council of Educational Research and Training. (2025a). PARAKH Rashtriya Sarvekshan 2024: National report. https://parakh.ncert.gov.in/sites/default/files/2025-07/REPORT_India_IND.pdf [Google Scholar] [Crossref]
40. National Council of Educational Research and Training. (2025b). PARAKH Rashtriya Sarvekshan 2024: Karnataka state report. https://parakh.ncert.gov.in/sites/default/files/2025-07/REPORT_Karnataka_IND029.pdf [Google Scholar] [Crossref]
41. O'Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research. Review of Educational Research, 78(1), 33–84. https://doi.org/10.3102/0034654307313793 [Google Scholar] [Crossref]
42. Oliver, M., Venville, G., & Adey, P. (2012). Effects of a cognitive acceleration programme in a low socioeconomic high school in regional Australia. International Journal of Science Education, 34(9), 1393–1410. https://doi.org/10.1080/09500693.2012.673241 [Google Scholar] [Crossref]
43. Piaget, J., & Inhelder, B. (1969). The psychology of the child (H. Weaver, Trans.). Basic Books. [Google Scholar] [Crossref]
44. Scharfen, J., Peters, J. M., & Holling, H. (2018). Retest effects in cognitive ability tests: A meta-analysis. Intelligence, 67, 44–66. https://doi.org/10.1016/j.intell.2018.01.003 [Google Scholar] [Crossref]
45. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Houghton Mifflin. [Google Scholar] [Crossref]
46. Shayer, M. (1999). Cognitive acceleration through science education II: Its effects and scope. International Journal of Science Education, 21(8), 883–902. https://doi.org/10.1080/095006999290345 [Google Scholar] [Crossref]
47. Shayer, M., & Adey, P. S. (1993). Accelerating the development of formal thinking in middle and high school students IV: Three years after a two-year intervention. Journal of Research in Science Teaching, 30(4), 351–366. https://doi.org/10.1002/tea.3660300404 [Google Scholar] [Crossref]
48. Shayer, M., & Ginsburg, D. (2009). Thirty years on – a large anti-Flynn effect? (II): 13- and 14-year-olds. Piagetian tests of formal operations norms 1976–2006/7. British Journal of Educational Psychology, 79(3), 409–418. https://doi.org/10.1348/978185408X383123 [Google Scholar] [Crossref]
49. Shayer, M., Küchemann, D. E., & Wylam, H. (1976). The distribution of Piagetian stages of thinking in British middle and secondary school children. British Journal of Educational Psychology, 46(2), 164–173. https://doi.org/10.1111/j.2044-8279.1976.tb02308.x [Google Scholar] [Crossref]
50. Venville, G., & Oliver, M. (2015). The impact of a cognitive acceleration programme in science on students in an academically selective high school. Thinking Skills and Creativity, 15, 48–60. https://doi.org/10.1016/j.tsc.2014.11.004 [Google Scholar] [Crossref]
51. Welch, B. L. (1947). The generalization of 'Student's' problem when several different population variances are involved. Biometrika, 34(1–2), 28–35. https://doi.org/10.1093/biomet/34.1-2.28 [Google Scholar] [Crossref]
52. Zimmerman, C. (2007). The development of scientific thinking skills in elementary and middle school. Developmental Review, 27(2), 172–223. https://doi.org/10.1016/j.dr.2006.12.001 [Google Scholar] [Crossref]
53. Zwick, R. (2012). A review of ETS differential item functioning assessment procedures: Flagging rules, minimum sample size requirements, and criterion refinement (Research Report No. RR-12-08). Educational Testing Service. https://doi.org/10.1002/j.2333-8504.2012.tb02290.x [Google Scholar] [Crossref]
Metrics
Views & Downloads
Similar Articles
- Assessment of the Role of Artificial Intelligence in Repositioning TVET for Economic Development in Nigeria
- Teachers’ Use of Assure Model Instructional Design on Learners’ Problem Solving Efficacy in Secondary Schools in Bungoma County, Kenya
- “E-Booksan Ang Kaalaman”: Development, Validation, and Utilization of Electronic Book in Academic Performance of Grade 9 Students in Social Studies
- Analyzing EFL University Students’ Academic Speaking Skills Through Self-Recorded Video Presentation
- Major Findings of The Study on Total Quality Management in Teachers’ Education Institutions (TEIs) In Assam – An Evaluative Study