Vector-borne infectious diseases has continue to pose a significant challenge to global public health, and accurate and timely transmission prediction are crucial for effective intervention and control. The development of accurate and efficient vector-borne infectious disease predictive models has been the current trend in disease modeling. Modeling transmission, however, has assumed a discrete transmission space, which is not always ideal in the real world, and little attention has been paid to overestimation biases in predictions. The effectiveness of a predictive model is also determined by its capability to capture a significant number of data characteristics to enhance robust and accurate prediction of cases. The study proposed the application of a GIS-enhanced Bayesian Reinforcement learning model for the transmission of vector-borne infectious diseases, and model performance assessment was determined. The Bayesian quantifies the uncertainty in the parameters of models, and min-max ensemble Q-value estimation minimizes overestimation bias in the model. Simulation study was used to evaluate model performance, success rate, and interaction rate. The findings show that vector and human can avoid interaction with a success rate of 96.2% when human select combined intervention actions spray repellent, insecticide treated nets, larval management, and vaccination. Other variables such as education, wealth index, community participation, and gender empowerment significantly influence the transmission of the disease in the area. The model demonstrates a better performance in describing the transmission of the disease, therefore setting the stage for future research in predictive modeling within sub-Saharan disease-prone regions. The model can be used to determine the appropriate actions that the human should adopt to reduce human-vector interaction.
| Published in | International Journal of Data Science and Analysis (Volume 12, Issue 2) |
| DOI | 10.11648/j.ijdsa.20261202.12 |
| Page(s) | 25-36 |
| Creative Commons |
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited. |
| Copyright |
Copyright © The Author(s), 2026. Published by Science Publishing Group |
Geographic Information System, Bayesian, Reinforcement Learning, Infectious Disease, Transmission
| [1] | S. Bin, G. Sun, and C.-C. Chen, “Spread of infectious disease modeling and analysis of different factors on spread of infectious disease based on cellular automata,” International journal of environmental research and public health, vol. 16, no. 23, p. 4683, 2019. |
| [2] | P. J. White, “Mathematical models in infectious disease epidemiology,” in Infectious Diseases (Fourth Edition), pp. 49–53.e1, Elsevier, 2017. |
| [3] | P. Zhang, K. Feng, Y. Gong, J. Lee, S. Lomonaco, and L. Zhao, “Usage of compartmental models in predicting covid-19 outbreaks,” The AAPS Journal, vol. 24, no. 5, p. 98, 2022. |
| [4] | M. Osman and I. Adu, “Simple mathematical model for malaria transmission,” Journal of Advances in Mathematics and Computer Science, vol. 25, no. 6, pp. 1–24, 2017. |
| [5] | E. Dantas, M. Tosin, and A. Cunha Jr, “Calibration of a seir–sei epidemic model to describe the zika virus outbreak in brazil,” Applied Mathematics and Computation, vol. 338, pp. 249–259, 2018. |
| [6] | M. S. Paolella, Linear models and time-series analysis: regression, ANOVA, ARMA and GARCH. John Wiley & Sons, 2018. |
| [7] | R. Anokye, E. Acheampong, I. Owusu, and E. Isaac Obeng, “Time series analysis of malaria in kumasi: Using arima models to forecast future incidence,” Cogent social sciences, vol. 4, no. 1, p. 1461544, 2018. |
| [8] | R. Mopuri, S. G. Kakarla, S. R. Mutheneni, M. R. Kadiri, and S. Kumaraswamy, “Climate based malaria forecasting system for andhra pradesh, india,” Journal of Parasitic Diseases, vol. 44, pp. 497–510, 2020. |
| [9] | A. M. Adeola, J. O. Botai, J. M. Olwoch, H. C. J. d. W. Rautenbach, O. M. Adisa, C. De Jager, C. M. Botai, and M. Aaron, “Predicting malaria cases using remotely sensed environmental variables in nkomazi, south africa,” Geospatial health, vol. 14, no. 1, 2019. |
| [10] | O. Stojanovic, J. Leugering, G. Pipa, S. Ghozzi, and A. Ullrich, “A bayesian monte carlo approach for predicting the spread of infectious diseases,” PloS one, vol. 14, no. 12, p. e0225838, 2019. |
| [11] | S. Funk, A. Camacho, A. J. Kucharski, R. M. Eggo, and W. J. Edmunds, “Real-time forecasting of infectious disease dynamics with a stochastic semi-mechanistic model,” Epidemics, vol. 22, pp. 56–61, 2018. |
| [12] | A. Gelman, J. B. Carlin, H. S. Stern, and D. B. Rubin, Bayesian data analysis (Vol. 2). Taylor & Francis Boca Raton, 2014. |
| [13] | A. P. Galvani and R. M. May, “Dimensions of superspreading,” Nature, vol. 438, no. 7066, pp. 293–295, 2005. |
| [14] | G. Giordano, F. Blanchini, R. Bruno, P. Colaneri, A. Di Filippo, A. Di Matteo, and M. Colaneri, “Modelling the covid-19 epidemic and implementation of population-wide interventions in italy,” Nature medicine, vol. 26, no. 6, pp. 855–860, 2020. |
| [15] | E. Hunter, B. Mac Namee, and J. D. Kelleher, “A model for the spread of infectious diseases in a region,” International journal of environmental research and public health, vol. 17, no. 9, p. 3119, 2020. |
| [16] | O. E. Santangelo, V. Gentile, S. Pizzo, D. Giordano, and F. Cedrone, “Machine learning and prediction of infectious diseases: a systematic review,” Machine Learning and Knowledge Extraction, vol. 5, no. 1, pp. 175–198, 2023. |
| [17] | Y. Shi, X. Liu, S.-Y. Kok, J. Rajarethinam, S. Liang, G. Yap, C.-S. Chong, K.-S. Lee, S. S. Y. Tan, C. K. Y. Chin, et al., “Three-month real-time dengue forecast models: an early warning system for outbreak alerts and policy decision support in singapore,” Environmental health perspectives, vol. 124, no. 9, pp. 1369–1375, 2016. |
| [18] | Y. Chen, C. W. Chu, M. I. C. Chen, and A. R. Cook, “The utility of lasso-based models for real time forecasts of endemic infectious diseases: A cross country comparison,” Journal of biomedical informatics, vol. 81, pp. 16–30, 2018. |
| [19] | C. M. Benedum, K. M. Shea, H. E. Jenkins, L. Y. Kim, and N. Markuzon, “Weekly dengue forecasts in iquitos, peru; san juan, puerto rico; and singapore,” Plos Neglected tropical diseases, vol. 14, no. 10, p. e0008710, 2020. |
| [20] | A. A. Kolesnikov, P. M. Kikin, and A. M. Portnov, “Diseases spread prediction in tropical areas by machine learning methods ensembling and spatial analysis techniques,” The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. 42, pp. 221–226, 2019. |
| [21] | V.-H. Nguyen, T. T. Tuyet-Hanh, J. Mulhall, H. V. Minh, T. Q. Duong, N. V. Chien, N. T. T. Nhung, V. H. Lan, H. B. Minh, D. Cuong, et al., “Deep learning models for forecasting dengue fever based on climate data in vietnam,” PLoS Neglected Tropical Diseases, vol. 16, no. 6, p. e0010509, 2022. |
| [22] | S. Chae, S. Kwon, and D. Lee, “Predicting infectious disease using deep learning and big data,” International journal of environmental research and public health, vol. 15, no. 8, p. 1596, 2018. |
| [23] | T. Santosh, D. Ramesh, and D. Reddy, “Lstm based prediction of malaria abundances using big data,” Computers in Biology and Medicine, vol. 124, p. 103859, 2020. |
| [24] | V. K. R. Chimmula and L. Zhang, “Time series forecasting of covid-19 transmission in canada using lstm networks,” Chaos, solitons & fractals, vol. 135, p. 109864, 2020. |
| [25] | Y. Guo, Y. Feng, F. Qu, L. Zhang, B. Yan, and J. Lv, “Prediction of hepatitis e using machine learning models,” Plos one, vol. 15, no. 9, p. e0237750, 2020. |
| [26] | A. K. M. Masum, S. A. Khushbu, M. Keya, S. Abujar, and S. A. Hossain, “Covid-19 in bangladesh: a deeper outlook into the forecast with prediction of upcoming per day cases using time series,” Procedia Computer Science, vol. 178, pp. 291–300, 2020. |
| [27] | A. Adiga, L. Wang, B. Hurt, A. Peddireddy, P. Porebski, S. Venkatramanan, B. L. Lewis, and M. Marathe, “All models are useful: Bayesian ensembling for robust high resolution covid-19 forecasting,” in Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 2505–2513, 2021. |
| [28] | T. Goo, C. Apio, G. Heo, D. Lee, J. H. Lee, J. Lim, K. Han, and T. Park, “Forecasting of the covid-19 pandemic situation of korea,” Genomics & Informatics, vol. 19, no. 1, 2021. |
| [29] | S. L. Kumar et al., “Predictive analytics of covid-19 pandemic: statistical modelling perspective,” Walailak Journal of Science and Technology (WJST), vol. 18, no. 16, pp. 15583–14, 2021. |
| [30] | L. Shen, C. Jiang, M. Sun, X. Qiu, J. Qian, S. Song, Q. Hu, H. Yelixiati, and K. Liu, “Predicting the spatial-temporal distribution of human brucellosis in europe based on convolutional long short-term memory network,” The Canadian Journal of Infectious Diseases & Medical Microbiology= Journal Canadien des Maladies Infectieuses et de la Microbiologie Médicale, vol. 2022, 2022. |
| [31] | S. Shaier, M. Raissi, and P. Seshaiyer, “Data-driven approaches for predicting spread of infectious diseases through dinns: Disease informed neural networks,” arXiv preprint arXiv: 2110.05445, 2021. |
| [32] | P. M. Brock, K. M. Fornace, M. J. Grigg, N. M. Anstey, T. William, J. Cox, C. J. Drakeley, H. M. Ferguson, and R. R. Kao, “Predictive analysis across spatial scales links zoonotic malaria to deforestation,” Proceedings of the Royal Society B, vol. 286, no. 1894, p. 20182351, 2019. |
| [33] | A. Ajith, K. Manoj, H. Kiran, P. J. Pillai, and J. J. Nair, “A study on prediction and spreading of epidemic diseases,” in 2020 International Conference on Communication and Signal Processing (ICCSP), pp. 1265–1268, IEEE, 2020. |
| [34] | K. Roster, C. Connaughton, and F. A. Rodrigues, “Forecasting new diseases in low-data settings using transfer learning,” Chaos, Solitons & Fractals, vol. 161, p. 112306, 2022. |
| [35] | R. Keshavamurthy, S. Dixon, K. T. Pazdernik, and L. E. Charles, “Predicting infectious disease for biopreparedness and response: A systematic review of machine learning and deep learning approaches,” One Health, p. 100439, 2022. |
| [36] | Y. Li, “Deep reinforcement learning: An overview,” arXiv preprint arXiv: 1701.07274, 2017. |
| [37] | Z. Zhou, G. Liu, and Y. Tang, “Multi-agent reinforcement learning: Methods, applications, visionary prospects, and challenges. arxiv 2023,” arXiv preprint arXiv: 2305.10091, 2023. |
| [38] | V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, “Playing atari with deep reinforcement learning,” arXiv preprint arXiv: 1312.5602, 2013. |
| [39] | A. Karras, C. Karras, S. Sioutas, C. Makris, G. Katselis, I. Hatzilygeroudis, J. A. Theodorou, and D. Tsolis, “An integrated gis-based reinforcement learning approach for efficient prediction of disease transmission in aquaculture,” Information, vol. 14, no. 11, p. 583, 2023. |
| [40] | P. Rajpurkar, V. Polamreddi, and A. Balakrishnan, “Malaria likelihood prediction by effectively surveying households using deep reinforcement learning,” arXiv preprint arXiv: 1711.09223, 2017. |
| [41] | L. Bucsoniu, R. Babuvska, and B. De Schutter, “Multi-agent reinforcement learning: An overview,” Innovations in multi-agent systems and applications-1, pp. 183–221, 2010. |
| [42] | L. Li, Y. Lv, and F.-Y. Wang, “Traffic signal timing via deep reinforcement learning,” IEEE/CAA Journal of Automatica Sinica, vol. 3, no. 3, pp. 247–254, 2016. |
| [43] | Y. Zhu, Z. He, and G. Li, “A bi-hierarchical game-theoretic approach for network-wide traffic signal control using trip-based data,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 9, pp. 15408–15419, 2022. |
| [44] | S. Khalilpourazari and H. H. Doulabi, “Using reinforcement learning to forecast the spread of covid-19 in france,” in 2021 IEEE international conference on autonomous systems (ICAS), pp. 1–8, IEEE, 2021. |
| [45] | S. Khalilpourazari and H. Hashemi Doulabi, “Designing a hybrid reinforcement learning based algorithm with application in prediction of the covid-19 pandemic in quebec,” Annals of Operations Research, pp. 1–45, 2021. |
| [46] | A. Agrawal, S. J. Won, T. Sharma, M. Deshpande, and C. McComb, “A multi-agent reinforcement learning framework for intelligent manufacturing with autonomous mobile robots,” Proceedings of the Design Society, vol. 1, pp. 161–170, 2021. |
| [47] | U. Pham, Q. Luu, and H. Tran, “Multi-agent reinforcement learning approach for hedging portfolio problem,” Soft Computing, vol. 25, pp. 7877–7885, 2021. |
| [48] | J. Hu, M. P. Wellman, et al., “Multiagent reinforcement learning: theoretical framework and an algorithm.,” in ICML, vol. 98, pp. 242–250, 1998. |
| [49] | M. Bowling and M. Veloso, An analysis of stochastic game theory for multiagent reinforcement learning. Citeseer, 2000. |
| [50] | A. Tampuu, T. Matiisen, D. Kodelja, I. Kuzovkin, K. Korjus, J. Aru, J. Aru, and R. Vicente, “Multiagent cooperation and competition with deep reinforcement learning,” PloS one, vol. 12, no. 4, p. e0172395, 2017. |
| [51] | S. Fujimoto, H. Hoof, and D. Meger, “Addressing function approximation error in actor-critic methods,” in International conference on machine learning, pp. 1587–1596, PMLR, 2018. |
| [52] | Esri, “What is gis? — geographic information system (gis),” 2024. |
| [53] | E. K. Cromley, “Gis and disease,” Annual review of public health, vol. 24, no. 1, pp. 7–24, 2003. |
| [54] | S. Saran, P. Singh, V. Kumar, and P. Chauhan, “Review of geospatial technology for infectious disease surveillance: use case on covid-19,” Journal of the Indian Society of Remote Sensing, vol. 48, pp. 1121–1138, 2020. |
| [55] | T. S. Churcher, R. E. Sinden, N. J. Edwards, I. D. Poulton, T. W. Rampling, P. M. Brock, J. T. Griffin, L. M. Upton, S. E. Zakutansky, K. A. Sala, et al., “Probability of transmission of malaria from mosquito to human is regulated by mosquito parasite density in naive and vaccinated hosts,” PLoS pathogens, vol. 13, no. 1, p. e1006108, 2017. |
| [56] | P. Li, D. Chen, Y. Wang, L. Zhang, and S. Zhao, “Path planning of mobile robot based on improved td3 algorithm in dynamic environment,” Heliyon, 2024. |
| [57] | H. Wang, S. Lin, and J. Zhang, “Adaptive ensemble q-learning: Minimizing estimation bias via error feedback,” Advances in neural information processing systems, vol. 34, pp. 24778–24790, 2021. |
| [58] | X. Chen, C. Wang, Z. Zhou, and K. Ross, “Randomized ensembled double q-learning: Learning fast without a model,” arXiv preprint arXiv: 2101.05982, 2021. |
| [59] | G. Chowell and R. Rothenberg, “Spatial infectious disease epidemiology: on the cusp,” 2018. |
| [60] | S. Jung, J. Jeoung, H. Kang, and T. Hong, “Optimal planning of a rooftop pv system using gis-based reinforcement learning,” Applied Energy, vol. 298, p. 117239, 2021. |
| [61] | C. Bone, “Integrating complexity science and artificial intelligence: Gis, agents and reinforcement learning for modeling forest cover change,” 2009. |
| [62] | N. M. Khiem, Y. Takahashi, H. Yasuma, D. T. H. Oanh, T. N. Hai, V. N. Ut, and N. Kimura, “Use of gis and machine learning to predict disease in shrimp farmed on the east coast of the mekong delta, vietnam,” Fisheries Science, pp. 1–13, 2022. |
APA Style
Gideon, K., Musau, V. M., Kinyua, M. W. (2026). GIS-Enhanced Bayesian Reinforcement Learning for Vector-Borne Infectious Disease Transmission. International Journal of Data Science and Analysis, 12(2), 25-36. https://doi.org/10.11648/j.ijdsa.20261202.12
ACS Style
Gideon, K.; Musau, V. M.; Kinyua, M. W. GIS-Enhanced Bayesian Reinforcement Learning for Vector-Borne Infectious Disease Transmission. Int. J. Data Sci. Anal. 2026, 12(2), 25-36. doi: 10.11648/j.ijdsa.20261202.12
@article{10.11648/j.ijdsa.20261202.12,
author = {Kipngetich Gideon and Victor Muthama Musau and Margaret Wambui Kinyua},
title = {GIS-Enhanced Bayesian Reinforcement Learning for Vector-Borne Infectious Disease Transmission
},
journal = {International Journal of Data Science and Analysis},
volume = {12},
number = {2},
pages = {25-36},
doi = {10.11648/j.ijdsa.20261202.12},
url = {https://doi.org/10.11648/j.ijdsa.20261202.12},
eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.ijdsa.20261202.12},
abstract = {Vector-borne infectious diseases has continue to pose a significant challenge to global public health, and accurate and timely transmission prediction are crucial for effective intervention and control. The development of accurate and efficient vector-borne infectious disease predictive models has been the current trend in disease modeling. Modeling transmission, however, has assumed a discrete transmission space, which is not always ideal in the real world, and little attention has been paid to overestimation biases in predictions. The effectiveness of a predictive model is also determined by its capability to capture a significant number of data characteristics to enhance robust and accurate prediction of cases. The study proposed the application of a GIS-enhanced Bayesian Reinforcement learning model for the transmission of vector-borne infectious diseases, and model performance assessment was determined. The Bayesian quantifies the uncertainty in the parameters of models, and min-max ensemble Q-value estimation minimizes overestimation bias in the model. Simulation study was used to evaluate model performance, success rate, and interaction rate. The findings show that vector and human can avoid interaction with a success rate of 96.2% when human select combined intervention actions spray repellent, insecticide treated nets, larval management, and vaccination. Other variables such as education, wealth index, community participation, and gender empowerment significantly influence the transmission of the disease in the area. The model demonstrates a better performance in describing the transmission of the disease, therefore setting the stage for future research in predictive modeling within sub-Saharan disease-prone regions. The model can be used to determine the appropriate actions that the human should adopt to reduce human-vector interaction.
},
year = {2026}
}
TY - JOUR T1 - GIS-Enhanced Bayesian Reinforcement Learning for Vector-Borne Infectious Disease Transmission AU - Kipngetich Gideon AU - Victor Muthama Musau AU - Margaret Wambui Kinyua Y1 - 2026/06/10 PY - 2026 N1 - https://doi.org/10.11648/j.ijdsa.20261202.12 DO - 10.11648/j.ijdsa.20261202.12 T2 - International Journal of Data Science and Analysis JF - International Journal of Data Science and Analysis JO - International Journal of Data Science and Analysis SP - 25 EP - 36 PB - Science Publishing Group SN - 2575-1891 UR - https://doi.org/10.11648/j.ijdsa.20261202.12 AB - Vector-borne infectious diseases has continue to pose a significant challenge to global public health, and accurate and timely transmission prediction are crucial for effective intervention and control. The development of accurate and efficient vector-borne infectious disease predictive models has been the current trend in disease modeling. Modeling transmission, however, has assumed a discrete transmission space, which is not always ideal in the real world, and little attention has been paid to overestimation biases in predictions. The effectiveness of a predictive model is also determined by its capability to capture a significant number of data characteristics to enhance robust and accurate prediction of cases. The study proposed the application of a GIS-enhanced Bayesian Reinforcement learning model for the transmission of vector-borne infectious diseases, and model performance assessment was determined. The Bayesian quantifies the uncertainty in the parameters of models, and min-max ensemble Q-value estimation minimizes overestimation bias in the model. Simulation study was used to evaluate model performance, success rate, and interaction rate. The findings show that vector and human can avoid interaction with a success rate of 96.2% when human select combined intervention actions spray repellent, insecticide treated nets, larval management, and vaccination. Other variables such as education, wealth index, community participation, and gender empowerment significantly influence the transmission of the disease in the area. The model demonstrates a better performance in describing the transmission of the disease, therefore setting the stage for future research in predictive modeling within sub-Saharan disease-prone regions. The model can be used to determine the appropriate actions that the human should adopt to reduce human-vector interaction. VL - 12 IS - 2 ER -