Optimising Construction Contract Rates with Z-Score and Machine Learning Approaches

This study evaluates two common techniques for contracting rate rationalisation in construction using Z-score statistical screening and machine learning (ML) models on a real-world tender dataset (single project; ten tenderers). We compare a human-in-the-loop, two-stage process where Z-scores act as an initial, auditable filter to detect unusual bids, and ML (regression and clustering) develops context-aware price benchmarks from the multivariate features. Empirically, the ML method achieved a 38% reduction in the RMSE compared to a Z- score-only baseline, whereas the hybrid approach reduced false alarms and produced more consistent and clearer pricing ranges for decision support. Z-score screening maintained operational value by standardising anomaly detection and enhancing procedural transparency, whereas ML improved the predictive accuracy and adaptability to item, project, and market differences. The results show that combining transparent statistical rules with data-driven models improves the accuracy, efficiency, and fairness of tender assessments. The contributions of this study are threefold: (i) a direct comparison of Z-score versus ML at the Bill-of-Quantities level; (ii) a governance-ready hybrid protocol that blends auditable thresholds with model-based benchmarks; and (iii) practical guidance for agencies seeking to embed analytics within e-procurement systems. Although the scope is limited to a single-project dataset, the findings support further validation across multiple projects and real- time deployment with drift monitoring in future research.

rate rationalisation, Z-score, machine learning, procurement governance

1. Abidi, W. U. H., Daoud, M. S., Ihnaini, B., Khan, M. A., Alyas, T., Fatima, A., & Ahmad, M. (2021). Real-Time Shill Bidding Fraud Detection Empowered with Fussed Machine Learning. IEEE Access, 9. https://doi.org/10.1109/ACCESS.2021.3098628 [Google Scholar] [Crossref]

2. Akinosho, T. D., Oyedele, L. O., Bilal, M., Ajayi, A. O., Delgado, M. D., Akinade, O. O., & Ahmed, A. A. (2020). Deep learning in the construction industry: A review of present status and future innovations. Journal of Building Engineering, 32. https://doi.org/10.1016/j.jobe.2020.101827 [Google Scholar] [Crossref]

3. Alameri, A., Alhammadi, A. S. A. M., Memon, A. H., Rahman, I. A., & Nasaruddin, N. A. N. (2021). Assessing the Risk Level of the Challenges Faced In Construction Projects. Engineering, Technology & Applied Science Research, 11(3). https://doi.org/10.48084/etasr.4020 [Google Scholar] [Crossref]

4. Alshboul, O., Shehadeh, A., Mamlook, R. E. Al, Almasabha, G., Almuflih, A. S., & Alghamdi, S. Y. (2022). Prediction Liquidated Damages via Ensemble Machine Learning Model: Towards Sustainable Highway Construction Projects. Sustainability (Switzerland), 14(15). https://doi.org/10.3390/su14159303 [Google Scholar] [Crossref]

5. Benallal, H., Abouelaziz, I., Mourchid, Y., Alfalou, A., Tairi, H., Riffi, J., & El Hassouni, M. (2022). A new approach for removing point cloud outliers using the standard score. https://doi.org/10.1117/12.2618835 [Google Scholar] [Crossref]

6. Bilal, M., & Oyedele, L. O. (2020). Guidelines for applied machine learning in construction industry—A case of profit margins estimation. Advanced Engineering Informatics, 43. https://doi.org/10.1016/j.aei.2019.101013 [Google Scholar] [Crossref]

7. Cerulli, G. (2022). Machine learning using Stata/Python. Stata Journal, 22(4). https://doi.org/10.1177/1536867X221140944 [Google Scholar] [Crossref]

8. Chakraborty, D., Elhegazy, H., Elzarka, H., & Gutierrez, L. (2020). A novel construction cost prediction model using hybrid natural and light gradient boosting. Advanced Engineering Informatics, 46. https://doi.org/10.1016/j.aei.2020.101201 [Google Scholar] [Crossref]

9. Choi, S. W., Lee, E. B., & Kim, J. H. (2021). The engineering machine-learning automation platform (Emap): A big-data-driven ai tool for contractors’ sustainable management solutions for plant projects. Sustainability (Switzerland), 13(18). https://doi.org/10.3390/su131810384 [Google Scholar] [Crossref]

10. Elen, A., & Avuçlu, E. (2021). Standardized Variable Distances: A distance-based machine learning method. Applied Soft Computing, 98. https://doi.org/10.1016/j.asoc.2020.106855 [Google Scholar] [Crossref]

11. Gu, S. (2023). Construction Cost Index Prediction Based on Machine Learning. International Conference on Applied Intelligence and Sustainable Computing, ICAISC 2023. https://doi.org/10.1109/ICAISC58445.2023.10199679 [Google Scholar] [Crossref]

12. Imron, M. A. & B. P. (2020). Improving Algorithm Accuracy K-Nearest Neighbor Using Z-Score Normalization and Particle Swarm Optimization to Predict Customer Churn. Journal of Soft Computing Exploration, 1(1). https://doi.org/10.52465/joscex.v1i1.7 [Google Scholar] [Crossref]

13. King, M., & Lanham, M. A. (2021). Logistic Regression: A Step by Step Solution Using Microsoft Excel. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3771522 [Google Scholar] [Crossref]

14. Lifia Zullani, Dodi Vionanda, Syafriandi Syafriandi, & Dina Fitria. (2023). Comparison of Error Rate Prediction in CART for Imbalanced Data. UNP Journal of Statistics and Data Science, 1(5). https://doi.org/10.24036/ujsds/vol1-iss5/117 [Google Scholar] [Crossref]

15. Mehrabani, M. N., Golafshani, E. M., & Ravanshadnia, M. (2020). Scoring of Tenders in Construction Projects Using Group Method of Data Handling. KSCE Journal of Civil Engineering, 24(7). https://doi.org/10.1007/s12205-020-1537-5 [Google Scholar] [Crossref]

16. Mir, M., Kabir, H. M. D., Nasirzadeh, F., & Khosravi, A. (2021). Neural network-based interval forecasting of construction material prices. Journal of Building Engineering, 39. https://doi.org/10.1016/j.jobe.2021.102288 [Google Scholar] [Crossref]

17. Molina-Miranda, M. F., Acaro, X., Molina, M., Quinoñez, M., Alvarez, G., Fernandez-Olivares, J., & Pérez, R. (2023). Application of explainable artificial intelligence to analyze basic features of a tender. International Conference on Electrical, Computer, Communications and Mechatronics Engineering, ICECCME 2023. https://doi.org/10.1109/ICECCME57830.2023.10253063 [Google Scholar] [Crossref]

18. Nguyen, P. T. (2021). Application Machine Learning in Construction Management. TEM Journal, 10(3). https://doi.org/10.18421/TEM103-48 [Google Scholar] [Crossref]

19. Ni, J., Hu, Y., & Zhong, R. Y. (2022). A hybrid machine learning method for procurement risk assessment of non-ferrous metals for manufacturing firms. International Journal of Computer Integrated Manufacturing, 35(10–11). https://doi.org/10.1080/0951192X.2021.1901315 [Google Scholar] [Crossref]

20. Nikulchev, E., & Chervyakov, A. (2023). Prediction Intervals: A Geometric View. In Symmetry (Vol. 15, Issue 4). https://doi.org/10.3390/sym15040781 [Google Scholar] [Crossref]

21. Nwachukwu, A., Jeong, H., Sun, A., Pyrcz, M., & Lake, L. W. (2018). Machine learning-based optimization of well locations and WAG parameters under geologic uncertainty. Proceedings - SPE Symposium on Improved Oil Recovery, 2018-April. https://doi.org/10.2118/190239-ms [Google Scholar] [Crossref]

22. Park, M. J., Lee, E. B., Lee, S. Y., & Kim, J. H. (2021). A digitalized design risk analysis tool with machine‐learning algorithm for epc contractor’s technical specifications assessment on bidding. Energies, 14(18). https://doi.org/10.3390/en14185901 [Google Scholar] [Crossref]

23. Park, U., Kang, Y., Lee, H., & Yun, S. (2022). A Stacking Heterogeneous Ensemble Learning Method for the Prediction of Building Construction Project Costs. Applied Sciences (Switzerland), 12(19). https://doi.org/10.3390/app12199729 [Google Scholar] [Crossref]

24. Patel, S., Park, B., Ezzati-Jivan, N., & Fournier, Q. (2021). Automated Cause Analysis of Latency Outliers Using System-Level Dependency Graphs. IEEE International Conference on Software Quality, Reliability and Security, QRS, 2021-December. https://doi.org/10.1109/QRS54544.2021.00054 [Google Scholar] [Crossref]

25. Pham, T. Q. D., Le-Hong, T., & Tran, X. V. (2023). Efficient estimation and optimization of building costs using machine learning. International Journal of Construction Management, 23(5). https://doi.org/10.1080/15623599.2021.1943630 [Google Scholar] [Crossref]

26. Putra, M. Y., Hayat, R. N., Chusyairi, A., Putri, D. I., & Solikin. (2022). Machine Learning Model Based on REST API for Predicting Tenders Winner. 2022 7th International Conference on Informatics and Computing, ICIC 2022. https://doi.org/10.1109/ICIC56845.2022.10006976 [Google Scholar] [Crossref]

27. Ramadhan, P. S., Marsono, Hutagalung, J., & Syahra, Y. (2021). Comparison of Knowledge-Based Reasoning Methods to Measure the Effectiveness of Diagnostic Results. Journal of Physics: Conference Series, 1783(1). https://doi.org/10.1088/1742-6596/1783/1/012049 [Google Scholar] [Crossref]

28. Rastegar, H., Shirani, B. A., Mirmohammadi, S. H., & Bajegani, E. A. (2021). A hybrid mathematical programming model and statistical approach for bidding price decision in construction projects. Journal of Project Management (Canada), 6(1). https://doi.org/10.5267/j.jpm.2020.10.003 [Google Scholar] [Crossref]

29. Saari, M. N., Mustafa Man, M., Adza Arshad, M., & Aezwani Wan Abu Bakar, W. (2024). J-Selaras: A new Innovation Model for Rate Rationalization in Contract Documents. INTERNATIONAL JOURNAL OF RESEARCH AND INNOVATION IN SOCIAL SCIENCE (IJRISS), Volume VIII(Issue X October 2024). https://doi.org/10.47772/IJRISS [Google Scholar] [Crossref]

30. Sanni-Anibire, M. O., Zin, R. M., & Olatunji, S. O. (2021). Machine learning - Based framework for construction delay mitigation. In Journal of Information Technology in Construction (Vol. 26). https://doi.org/10.36680/j.itcon.2021.017 [Google Scholar] [Crossref]

31. Sen, D., Chen, H., Datta-Gupta, A., Kwon, J., & Mishra, S. (2021). Machine learning based rate optimization under geologic uncertainty. Journal of Petroleum Science and Engineering, 207. https://doi.org/10.1016/j.petrol.2021.109116 [Google Scholar] [Crossref]

32. Sharma, V., Zaki, M., Jha, K. N., & Krishnan, N. M. A. (2022). Machine learning-aided cost prediction and optimization in construction operations. Engineering, Construction and Architectural Management, 29(3). https://doi.org/10.1108/ECAM-10-2020-0778 [Google Scholar] [Crossref]

33. Singh, D., & Singh, B. (2020). Investigating the impact of data normalization on classification performance. Applied Soft Computing, 97. https://doi.org/10.1016/j.asoc.2019.105524 [Google Scholar] [Crossref]

34. Theingi Aung, Liana, S. R., Htet, A., & Amiya Bhaumik. (2023). Using Machine Learning to Predict Cost Overruns in Construction Projects. Journal of Technology Innovations and Energy, 2(2). https://doi.org/10.56556/jtie.v2i2.511 [Google Scholar] [Crossref]

35. ur Rehman, A., & Belhaouari, S. B. (2021). Unsupervised outlier detection in multidimensional data. Journal of Big Data, 8(1). https://doi.org/10.1186/s40537-021-00469-z [Google Scholar] [Crossref]

36. Wang, Z., & Shafieezadeh, A. (2020). On confidence intervals for failure probability estimates in Kriging-based reliability analysis. Reliability Engineering and System Safety, 196. https://doi.org/10.1016/j.ress.2019.106758 [Google Scholar] [Crossref]

37. Xie, Y., Ebad Sichani, M., Padgett, J. E., & DesRoches, R. (2020). The promise of implementing machine learning in earthquake engineering: A state-of-the-art review. Earthquake Spectra, 36(4). https://doi.org/10.1177/8755293020919419 [Google Scholar] [Crossref]

• The Role of Artificial Intelligence in Revolutionizing Library Services in Nairobi: Ethical Implications and Future Trends in User Interaction
• ESPYREAL: A Mobile Based Multi-Currency Identifier for Visually Impaired Individuals Using Convolutional Neural Network
• Comparative Analysis of AI-Driven IoT-Based Smart Agriculture Platforms with Blockchain-Enabled Marketplaces
• AI-Based Dish Recommender System for Reducing Fruit Waste through Spoilage Detection and Ripeness Assessment
• SEA-TALK: An AI-Powered Voice Translator and Southeast Asian Dialects Recognition