Optimization of Support Vector Regression for Improved Prediction Accuracy in Cross-Sectional Data Using Genetic Algorithms
DOI:
https://doi.org/10.26750/87w4cn57Keywords:
Support Vector Regression (SVR), Genetic Algorithms (GA), Prediction Accuracy, Optimization Techniques.Abstract
Support Vector Regression (SVR) is a machine learning technique designed to predict continuous values by extending the principles of Support Vector Machines (SVM) into regression tasks. The performance of SVR models can be constrained by the selection of hyperparameters, which significantly affect the model’s predictive accuracy. To overcome this challenge, Genetic Algorithms (GA) can be utilized to optimize the hyperparameters of the SVR model. The GA demonstrated a steady improvement in fitness over 100 iterations. In this study, researchers focus on optimizing SVR for improved predictive accuracy in analysing cross-sectional data related to COVID-19 pandemic in Sulaymaniyah governorate. By leveraging GA for hyperparameter tuning, our research aims to evaluate the performance of a SVR with GA combined for optimizing complex, non-linear relationships in cross-sectional data, and improve the accuracy of the SVR model through GA. While previous research has explored optimizing similar models, to the best of the researchers' knowledge, this is the first study to apply such an optimized model to this specific dataset in Iraq and for medical field. The integration of SVR with Genetic Algorithms represents a novel approach in predictive modeling for COVID-19 pandemic related complications. Initially, the GA achieved a low mean fitness value of 0.0451, which steadily increased, reaching a peak of 0.0792. The results underscore the efficacy of this hybrid approach in finding optimal solutions, with predictions showing good alignment with actual data values. Overall, the integration of GA and SVR provided a robust method for solving complex optimization problems.
References
Aziz, A.A., Mahmood, H.O.F., Rahim, S.A., Maaroof, R.S. and Taher, H.A., 2023. Using Optimizing Parameters Support Vector Regression Model to Predict Potassium Ratio in Carb Fish. Journal of Survey in Fisheries Sciences, 10(3S), pp.4931-4937.
He, W., Wang, Z. and Jiang, H., 2008. Model optimizing and feature selecting for support vector regression in time series forecasting. Neurocomputing, 72(1-3), pp.600-611.
Shafizadeh-Moghadam, H., Tayyebi, A., Ahmadlou, M., Delavar, M.R. and Hasanlou, M., 2017. Integration of genetic algorithm and multiple kernel support vector regression for modeling urban growth. Computers, Environment and Urban Systems, 65, pp.28-40.
Farhadian, M., Shokouhi, P. and Torkzaban, P., 2020. A decision support system based on support vector machine for diagnosis of periodontal disease. BMC Research Notes, 13, pp.1-6.
Ksiazek, T.G., Erdman, D., Goldsmith, C.S., Zaki, S.R., Peret, T., Emery, S., Tong, S., Urbani, C., Comer, J.A., Lim, W. and Rollin, P.E., 2003. A novel coronavirus associated with severe acute respiratory syndrome. New England journal of medicine, 348(20), pp.1953-1966.
Maaroof, R.S., Rahim, S., Salih, S.O. and Taher, H.A., 2023. Estimating the impact of Pregnancy, Systolic and Age on Diabetes for Women by Using Support Vector Regression Model (SVR). Tikrit Journal of Administrative and Economic Sciences, 19(62 part 2).
Kakarash, Z.A., Ezat, H.S., Omar, S.A. and Ahmed, N.F., 2022. Time series forecasting based on support vector machine using particle swarm optimization. International Journal of Computing, 21(1), pp.76-88.
Hassanat, A., Almohammadi, K., Alkafaween, E.A., Abunawas, E., Hammouri, A. and Prasath, V.S., 2019. Choosing mutation and crossover ratios for genetic algorithms—a review with a new dynamic approach. Information, 10(12), p.390.
Smola, A.J. and Schölkopf, B., 2004. A tutorial on support vector regression. Statistics and computing, 14, pp.199-222.
World Health Organization, 2020. Laboratory testing for 2019 novel coronavirus (2019-nCoV) in suspected human cases: Interim guidance, 17 January 2020. World Health Organization.
Hamdia, K.M., Zhuang, X. and Rabczuk, T., 2021. An efficient optimization approach for designing machine learning models based on genetic algorithm. Neural Computing and Applications, 33(6), pp.1923-1933.
Fofanah, A.J. and Hwase, T.K., 2022. An Intelligence Computation of Genetic Algorithm and Its Application in Healthcare Systems: Algorithms, Methods, and Predictions. American Journal of Health Research, 10(6), pp.225-256.
Yuan, F.C., 2012. Parameters optimization using genetic algorithms in support vector regression for sales volume forecasting. Applied Mathematics, 3(10), pp.1480-1486.
Lessmann, S., Stahlbock, R. and Crone, S.F., 2006, July. Genetic algorithms for support vector machine model selection. In The 2006 IEEE International Joint Conference on Neural Network Proceedings (pp. 3063-3069). IEEE.
Li, K., Jia, L. and Shi, X., 2018, December. An efficient hybridized genetic algorithm. In 2018 IEEE International Conference of Safety Produce Informatization (IICSPI) (pp. 118-121). IEEE.
Sijben, E.M.C., Alderliesten, T. and Bosman, P.A., 2022, July. Multi-modal multi-objective model-based genetic programming to find multiple diverse high-quality models. In Proceedings of the Genetic and Evolutionary Computation Conference (pp. 440-448).
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Journal of University of Raparin
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
