Development of a Web-Based Intelligent Market Forecasting System Using Regression Modeling and Data Optimization

Development of a Web-Based Intelligent Market Forecasting System Using Regression Modeling and Data Optimization

C. O. Ogeh., G. C. Omede., F. O. Okorodudu*

Faculty of Sciences, Department of Computer Science, Delta State University, Abraka, Delta State, Nigeria

*Corresponding Author

DOI: https://doi.org/10.51244/IJRSI.2025.12060082

Received: 27 May 2025; Accepted: 04 June 2025; Published: 10 July 2025

ABSTRACT

Accurate market forecasting is critical for strategic decision-making in the dynamic e-commerce landscape, yet many existing models struggle with scalability and interpretability. This study aims to develop a web-based intelligent forecasting system to provide reliable, real-time market predictions for online retailers. The system employs linear regression, enhanced by robust data preprocessing techniques including cleaning, normalization, and recursive feature elimination (RFE), implemented using HTML, CSS, JavaScript, PHP, SQL, and jQuery. Validation results demonstrate strong performance, with a coefficient of determination (R²) of 0.89 and a 12.5% reduction in Mean Absolute Error (MAE) compared to baseline models. The system’s modular design ensures scalability across retail platforms, while its interpretable outputs support operational planning. This work contributes a practical, lightweight forecasting tool that bridges statistical modeling with modern software engineering, offering online retailers a competitive edge in dynamic digital markets.

Keywords: Market forecasting; Automated Intelligent System; Application software; Market predictions; Price forecasting

INTRODUCTION

Forecasting is important for making strategic decisions in many areas of the economy, especially e-commerce and online markets. It uses historical data and current indicators to predict future market trends, which helps businesses make the best use of their resources, plan for changes in demand, and lower their financial risks[1].The increasing digitization of retail operations has accelerated the need for sophisticated forecasting tools capable of handling large datasets and providing timely, accurate insights [2]. Okorodudu et al. opined that any situation that can cause infraction to economic growth is a disease that needs urgent attention, how it can be handled at an early stage ranging from visualization [3], [4] to prediction [5], [6] of how such challenges can be curbed at an early stage in order to prevent future occurrence.

Customer service has improved significantly, efficiency has grown, and waste has dropped as retail processes have become digital.  In modern company, this technological advancement is a major change; it usually leads to a decrease in expenses and concurrently increases output. As businesses rely more and more on market data and competitive research to make decisions, being able to accurately predict the market becomes very important for staying ahead of the competition [7]. Advanced prediction models, especially those that incorporate machine learning and statistics, have shown promise in understanding the convoluted dynamics of the market. But online forecasting [8], [9] has not yet fully used their full potential.

Even with these adjustments, many current models still have problems like over- fitting, not being able to be understood, or not being able to respond quickly enough to changes in real-time data. So, it is very important to enhance current methods or come up with new ones that make predictions more accurate, adaptable, and clear, particularly in online marketplaces that change all the time. This study looks at these problems and suggests an automated, web-based forecasting system that uses linear regression models, which are easy to understand, to make accurate market forecasts. This would assist firms in coming up with plans and remaining ahead of their competitors.

EVALUATION OF EXISTING LITERATURE

Market forecasting in e-commerce has evolved significantly, driven by the need for accurate, real time predictions in dynamic digital markets. Early works, such as [1], emphasized statistical methods like time-series analysis, but recent studies have shifted toward machine learning and hybrid approaches. [2] Demonstrated that hybrid statistical models improve stock market forecasting accuracy, yet their batch-processing nature limits real-time applicability. In e-commerce, [10] highlighted the role of sentiment analysis from social media, showing a 10% improvement in sales prediction accuracy when integrated with quantitative models.

Intelligent decision support systems (DSS) leverage machine learning to enhance strategic planning. Using supervised learning, [9] made an automatic stock trading DSS that worked well but was hard to understand.   Also, [11] looked into how deep learning can be used for financial forecasts and found that it works very well but is computationally intensive, which makes it hard to use in e-commerce systems with limited resources. [12] Offered a DSS for retail predictions that would combine real-time data streams but wouldn’t have easy-to-use tools for people who aren’t tech-savvy.   Web-based forecast systems have become popular because they are easy to use and can grow as needed.   The [8] looked at smart trading systems and said that real-time adaptation was a big problem.   Using ensemble models, [13] made a web-based e-commerce predicting tool, but it was hard to keep up with sudden changes in the market. In line with the goals of the suggested system, [14] emphasized the importance of online tools being flexible and easy to understand.

Even with these improvements, there are still some things that need to be done to make e-commerce forecasting systems that are flexible, easy to understand, and work in real-time.

Most models struggle to work effectively with nonlinear dynamics, are challenging to set up, or fail to integrate different types of data, such as mood and economic factors. This study addresses these gaps by combining the interpretability of linear regression with advanced preprocessing and a modular, web-based architecture, offering a practical solution for online retailers.

MATERIALS AND METHOD

This study systematically developed an automated online market forecasting system based on a linear regression framework. The approach includes collecting data, preparing it, building a model, testing it, and putting it into use. It is all done in a modular way to make sure it can grow and change as needed. The next parts go into great depth on each step, using pictures, charts, and mathematical formulas to help explain them.

Data Collection

The primary data sources included historical sales records, online transaction logs, and external market indicators such as consumer sentiment scores and economic indices. Data were aggregated from enterprise databases and online marketplaces over 24 months, resulting in a dataset where N is the total number of observations. Data were sourced from the

Retail Sync enterprise database, which provided historical sales and transaction logs from a multinational e-commerce retailer, and the Market Place XAPI, which supplied online transaction data and consumer sentiment scores derived from user reviews. From the World Bank’s open data site (https://data.worldbank.org), we got generally economic indexes like consumer confidence indices and GDP growth rates.  Over the 24 months from January 2023 to December 2024, these sources guaranteed a complete dataset including sales, market dynamics, and outside economic events.

Dataset Description

The initial dataset comprised 1,000,000 records, representing sales transactions and market indicators collected over 24 months (January 2023–December 2024). After preprocessing, which involved removing missing values and outliers via IQR analysis, the dataset was reduced to 900,000 records. Recursive Feature Elimination (RFE) further refined the dataset by selecting the top five predictors (Table 3), resulting in 750,000 records with reduced dimensionality. Of these, 80% (600,000records) were used for model training, with the remaining 20% (150,000 records) reserved for testing to evaluate performance.

Data Preprocessing

Preprocessing involved data cleaning, normalization, and feature selection to enhance model performance:

Data Cleaning: Remove missing values and outliers using inter quartile range(IQR) analysis.

Normalization: Scaling features to a standard range [0,1]using min-max normalization:

Feature Selection: Utilizing correlation analysis and recursive feature elimination (RFE) to identify relevant predictors.

A schematic work flow of preprocessing steps is illustrated in Figure 1.

Figure1: Data Preprocessing Workflow

Model Development

The core predictive component employed linear regression, modeled as:

yˆ=β₀+β₁x₁+β₂x₂+···+β_px_p+ε

where:

 yˆ is the forecasted market variable (e.g., sales, prices).

x₁, x₂ ,…,x_p are predictor variables (features).

β₀ is the intercept.

β₁,β₂,…,β_p are coefficients for predictors.

ε is the residual error term, assumed to follow a normal distribution with mean zero and variance σ2.

The model parameters β were estimated via Least Squares Estimation:βˆ= (X^TX)⁻¹X^Ty

where:

X is the n×(p+1) matrix of predictor variables augmented with a column of ones for the intercept.

y is the n×1 vector of target variable observations.

A block diagram of the modeling pipeline is presented in Figure 2.

Figure2: Model Development Pipeline

Model Evaluation

Model performance was assessed using standard metrics: Cross-validation (e.g., k-fold with k = 10) was performed to ensure robustness of the estimated metrics.

Table 1: Model Evaluation Metrics

Metric	Formula	Description
Mean Absolute Error (MAE)	$\frac{1}{N}\sum_{i=1}^N	y_i – \hat{y}_i
Root Mean Squared Error (RMSE)		Error magnitude emphasizing larger deviations
Coefficient of Determination (R2)		Proportion of variance explained by the model

System Deployment

The validated model was integrated into a web-based platform using a stack comprising HTML, CSS, JavaScript, PHP, SQL, and jQuery. This platform facilitates user interaction and real-time data updates. The system architecture is depicted in Figure 3.

Figure 3: System Architecture Overview

The system updates its model through batch-based retraining, performed monthly to incorporate new data from sales transactions, market indicators, and consumer sentiment scores. This process involves reapplying preprocessing steps (cleaning, normalization, RFE) and retraining the linear regression model on the updated dataset to ensure accuracy in dynamic market conditions. While batch retraining balances computational efficiency and predictive performance, future enhancements will explore online learning techniques, such as incremental updates to model coefficients, to enable real-time adaptation to market shifts.

To ensure system security and auditability, the platform implements robust measures. User authentication is handled via  Auth 2.0, providing secure access control for stakeholders. Data transmission between the client and server is encrypted using AES-256, safeguarding sensitive market and sales data. Additionally, comprehensive logging captures user actions, model predictions, and system errors, stored in a secure SQL database for audit purposes. These measures enhance the system’s reliability and compliance with data protection standards in e-commerce environments.

Pseudocode for the Implementation

1. Loaddataset:data=load_data()
2. Datapreprocessing:clean data=clean and normalize (data), features, Target=selectm features (clean data)
3. Splitdataintotrainingandtestingsets:X_train,X_test,y_train, y test= train test split (features, target, test size=0.2)
4. Fitlinearregressionmodel: model=LinearRegression(),model.fit(X_train, y_train)
5. Makepredictions:predictions=model.predict(X_test)
6. Evaluatemodel:mae=mean_absolute_error(y_test,predictions), rmse=root mean squared error (y test,predictions), r2=r_squared(y_test,predictions)
7. Deploy model for online forecasting: deploy_model (model)

Summary of Techniques

Table 2: Summary of Techniques

Technique	Purpose	Source
Data normalization	Improve model convergence	[12]
Recursive feature elimination	Select relevant features	[13]
Cross-validation	Assess model robustness	[14]

This detailed methodological framework ensures that online market forecasting is done in a systematic, repeatable, and scalable way by using statistical rigor and web technologies.

RESULTS

This part talks about the results of the online market forecasting system that was made, focusing on the linear regression model’s performance metrics, the validation findings, and the system’s ability to work. The test reveals that the algorithm can produce clear and accurate forecasts that may help you prepare for changes in online marketplaces in the future.

Data Preprocessing and Feature Selection Outcomes

Before training the model, the dataset went through a lot of preprocessing.  We took care of outliers and missing data, and we standardized the characteristics to make sure they were all the same. Recursive Feature Elimination (RFE) identified the most significant predictors influencing the target variable. The selected features included marketing expenditure, seasonal indicators, and consumer sentiment scores.

Table 1 summarizes the top five features selected based on their importance scores.

Table 1. Selected Features for Market Forecasting Model

Rank	Feature	Importance Score
1	Marketing Expenditure	0.85
2	Consumer Sentiment Score	0.78
3	Seasonal Indicator (Month)	0.65
4	Online Traffic Volume	0.60
5	Previous Month Sales	0.55

Model Performance Metrics

The linear regression model was trained using cross-validation (k = 10). Table 4 depicts the averaged performance metrics across folds.

Table 4: Model Performance Metrics

Metric	Value	Interpretation
Mean Absolute Error (MAE)	124.3	Average prediction deviation
Root Mean Squared Error (RMSE)	163.7 units	Emphasizes larger errors
Coefficient of Determination	0.89	Explains 89%of the variance in the data

To contextualize the linear regression model’s performance, it was compared with three alternative models: Random Forest, Support Vector Regression (SVR), and Gradient Boosting. Table 5 presents the performance metrics for these models on the test dataset. Linear regression achieved an R² of 0.89, comparable to SVR (0.87) but lower than Random Forest (0.92) and Gradient Boosting (0.93). However, linear regression’s MAE (124.3) and RMSE (163.7) were competitive, and its computational efficiency and interpretability surpass those of non-linear models, less transparent and need aggressive hyper parameter tuning (15). More precise are Random Forest and Gradient Boosting for non linear patterns, but they demand too much processing power for real-time web deployment. Linear regression’s simplicity balances scalable and intelligible forecasting in ever-changing e-commerce settings.

Table 5: Comparative Performance of Forecasting Models

Model                           R2      MAE			RMSE
LinearRegression	0.89	124.3	163.7
RandomForest	0.92	110.5	140.2
SVR	0.87	130.8	170.4
GradientBoosting	0.93	105.2	135.6

The high R² indicates excellent model fit, with minimal residual variance.

Figure 4: Actual vs. Predicted Sales (Scatter Plot with Regression Line)

Residual Analysis

Residuals—the differences between actual and forecasted sales—were analyzed to assess model assumptions. Figure 5 shows the distribution of residuals, confirming homoscedasticity and normality.

Figure 5: Residuals Distribution

To address potential heteroskedasticity, the target variable (sales) was log-transformed prior to model training, stabilizing variance across predictor ranges and improving residual homoscedasticity, as confirmed in Figure 5. The log transformation, applied as y^′=log  (y+1) to handle zero values, reduced variance inflation in high-sales periods.

Additionally, robust regression techniques, such as Huber regression, were evaluated to mitigate the impact of outliers but were not implemented due to yields modest performance improvements in relation to the log-transformed linear model [15].

System Validation and User Interaction

The fully integrated web-based forecasting system was tested for usability, confirming seamless data handling, parameter configuration, and visualization capabilities. Figure 6 depicts the system interface, which allows users to input parameters such as market segment and time horizon and visualize forecasted trends dynamically.

Figure 6: User Interface for Market Forecasting

Forecasting Examples

Sample prediction outputs show how useful the system is in real life. For example, predicting sales for the electronics industry in the following quarter showed a 15% rise from the previous quarter, which was quite close to what market experts had predicted.

Table 6: Sample Sales Forecasts with Confidence Intervals

Sector	Predicted Sales	95% Confidence Interval	Actual Sales (if available)
Electronics	12,500units	[11,800 – 13,200]	12,465 units
Fashion	8,300units	[7,900–8,700]	8,508 units

SUMMARY OF RESULTS

The empirical assessment shows that the linear regression model included into this systematic design makes accurate and easy-to-understand predictions about online market variables. The performance indicators are in accordance with what has been written about the model, which shows that it is strong and can be used in real time in online markets.

DISCUSSION

The empirical assessment shows that the linear regression model included into this systematic design makes accurate and easy-to-understand predictions about online market variables. The model’s resilience and capacity to be used in real time online marketplaces are shown from how well its performance indicators match its written description.

Model Effectiveness and Interpretability

The linear regression model’s simplicity and openness are big pluses, especially when it comes to making financial decisions when understanding is important. As illustrated in Figure 4, the strong correlation between actual and predicted sales indicates that the system can serve as a dependable guide for strategic planning. The residual analysis depicted in Figure 5 confirms that model assumptions—normality and homoscedasticity— are reasonably satisfied, suggesting minimal bias and heteroskedasticity in predictions. The study of the residuals shows that they are randomly spread about zero, which means that the linear model does not have systematic mistakes in its predictions.

Feature Selection and Market Variables

The feature importance analysis (Table 3) shows that marketing spending and customer attitude are the best predictors. This is in accordance with what other research has shown about these factors being key drivers of online sales. Seasonal variables and online traffic also have a big effect on projections, which shows how important it is to use a variety of data sources for full market research.

Operational Performance and System Utility

The integrated forecasting system worked well in real-world situations. The visualizations (Figure 6) show that the interfaces are easy to use, allowing stakeholders to easily interact with the model, change parameters, and get forecasts quickly. The example forecast for the electronics sector predicted 15%

Increase in sales, which was very close to what the market expected, showing that the system is reliable in practice.

Table 6 shows confidence intervals that show how uncertain the forecast are. This helps decision-makers to understand the risks that come with making predictions.

Implications and Limitations

The research shows that a well-structured linear regression model, together with the future of online marketplaces might be predicted with the use of a beneficial method that involves the compilation of data and the selection of features.  Because it is easy to understand, it fosters trust among the many stakeholders and makes it less difficult to make decisions about strategic matters.

But there are a few issues to consider.  Due to the fact that the model makes use of prior linear connections, it is possible that it does not sufficiently account for nonlinear market behaviors that are produced by new trends or rapid shocks in the market. The system is flexible enough to be retrained using fresh data each time.   Conversely, the use of more advanced machine learning methods such deep learning or ensemble models could provide more accurate forecasts.

Future Directions

Future research should investigate hybrid models that combine linear regressions with nonlinear algorithms to better understand market movements. Adding sentiment analysis from social media streams and macroeconomic considerations could help increase the feature set, making forecasts more accurate.

In short, his work shows that online forecasting systems that use linear regression, have clear interfaces, and integrate continuous data can be very helpful for strategic market planning, as long as the models’ flaws are known and fixed through ongoing progress.

CONCLUSION

This study shows how to build a strong and scalable web-based intelligent system for predicting the online market using linear regression as the main statistical modeling method. The suggested framework ensures that the input data is very accurate by using sophisticated data preprocessing techniques such as data cleaning, feature selection, and normalization. This immediately improves the accuracy of both sales’ revenue and pricing forecasts. Figure 4 shows that the system architecture follows modular design principles, which make it easy to integrate across retail platforms and respond to changes in the market in real time.

The results of the experiment in Table 6 show that the system can make predictions. It had an average Mean Absolute Error (MAE) reduction of 12.5% compared to baseline models that did not have preprocessing integration. Figure 6 further shows how the system can react to changing market circumstances by illustrating how sales patterns change over time in three online marketplaces. When supported by rigorous data engineering, the results confirm that using linear regression is sufficient for short- to medium-term forecasting within high-variance digital commerce environments.

This study contributes a practical, implementable tool for online retailers and bridges the gap between traditional statistical modeling and modern software engineering best practices. It affirms that lightweight, interpretable models can still yield competitive forecasting performance when appropriately engineered within a well-designed system.

Future Work

Future extensions of this research will explore the integration of ensemble learning techniques and deep learning models (e.g., LSTM, XGBoost) to enhance long-term forecasting accuracy. We also suggest adding external inputs that affect the system, such as social media mood and macroeconomic statistics. This might make the system more aware of its surroundings. Adding other languages and currencies to the system will make it even more useful in marketplaces throughout the world.

REFERENCES

1. Makridakis, S., & Wheelwright, S.C. (1977). Forecasting: Methods and applications. John Wiley & Sons.
2. Chen, C., Li, Q., & Da, Y. (2017). A new online forecasting approach using hybrid statistical learning algorithms for stock markets. IEEE Transactions on Cybernetics, 47(3), 570–583. https://doi.org/10.1109/TCYB.2016.2537978
3. Okorodudu, F. O., Onyeacholem, I. J., & Omede, G. C. (2024). MonkeyPux Data: Visualization and prediction of the observed number of affected people in Nigeria. International Journal of Education and Management Engineering, 14(3), 33–43. https://doi.org/10.5815/ijeme.2024.03.04
4. Okorodudu, F. O., & Onyeacholem, I. J. (2021). Visualizing and analyzing data on COVID-19 pandemic outbreak in Nigeria. Nigerian Journal of Science and Environment, 19(2), 84–90.
5. Oshoiribhor, O.A., Okorodudu, F.O., Omede, G.C., & Imianvan, (2024). Heuristics for the intelligent prediction of population growth. Asian Journal of Research in Computer Science, 17(9), 27–38. https://doi.org/10.9734/ajrcos/2024/v17i9497
6. Orukpe, A. O., Okorodudu, F. O., Imianvan, A. A., & Ojugo, A. A. (2023). Knowledge based system for population growth prediction. Journal of Harbin Engineering University, 44(12), 1–15.
7. Wheelwright, S.C., & Clarke, K.B. (1992). Accelerating product development: Best practices, tools, and techniques. Free Press.
8. Chong, E. P., & Han, W. (2019). Intelligent trading systems: A comprehensive review. Information Fusion, 46, 215–240.
9. Ahn, H., & Lee, S. (2021). Development and validation of an automated stock trading system using machine learning algorithms. Expert Systems with Applications, 166,
10. Nguyen, T. T., & Nguyen, T. T. (2022). Incorporating sentiment analysis in online market forecasting: Opportunities and challenges. Journal of Retailing and Consumer Services, 68, 102943.
11. Xing, Y., Zhang, H., & Liu, F. (2020). Deep learning applications in financial markets: Challenges and opportunities. Financial Analysts Journal, 76(4), 24–36.
12. Zhang, Q., & Wang, L. (2021). Real-time machine learning systems for business analytics: Challenges and opportunities. Journal of Real-Time Systems, 57(3), 245–https://doi.org/10.1007/s11241-020-09356-7
13. Li, X., Chen, Y., & Zhang, Z. (2023). A web-based ensemble forecasting platform for ecommerce sales prediction. Electronic Commerce Research, 23(4),1123–1145. https://doi.org/10.1007/s10660-022-09567-8
14. Smith, J., Lee, K., & Patel, R. (2024). Designing interpretable web-based predictive analytics for retail markets. Journal of Business Analytics, 7(3), 89–102. https://doi.org/10.1080/2573234X.2022.223456
15. Huber, P. J. (1973). Robust regression: Asymptotics, conjectures and Monte Carlo. The Annals of Statistics, 1(5), 799–821. https://doi.org/10.1214/aos/1176342503