Implementation of Chatbot that Predicts an Illness Dynamically using Machine Learning Techniques

Document Type : Original Article

Authors

1 Nitte (Deemed to be University), NMAM Institute of Technology (NMAMIT), Department of Computer Science and Engineering, Nitte, India

2 Nitte (Deemed to be University), NMAM Institute of Technology (NMAMIT), Department of Mechanical Engineering, Nitte, India

Abstract

Timely access to healthcare is crucial in order to maintain a high standard of living. However, obtaining medical consultations can be difficult, especially for those living in remote areas or during a pandemic when face-to-face consultations are not always possible. The ability to accurately diagnose diseases is essential for effective treatment, and recent technological advancements offer a potential solution. Machine learning (ML) and Natural language processing (NLP) enables computer programs to understand human language and extract desired features from responses, allowing for human-like interaction with users. By leveraging these technologies, healthcare professionals can potentially provide more accessible and efficient medical consultations to individuals, regardless of their location. The concept is to establish an online platform where users can ask medical-related queries and receive responses from both medical professionals and fellow users. The platform would feature a Medical Chatbot, which employs advanced ML techniques to analyze user-provided symptoms and provide initial disease diagnosis and related information prior to consulting with a doctor. This disease prediction chatbot interacts dynamically with the users to enter the symptoms of the diseases and based on syntactic and semantic similarity response is given. In this work the threshold of similarity score is kept of 0.7. K-Nearest neighbors, Random forest, Support vector machine, Naive bayes and Logistic regression algorithms are used for prediction of disease based on symptoms which are faced by users. The syntactic similarity, fuzzy string matching and semantic similarity using all-MiniLM-L6-v2 model is used to improve the efficiency of the result.

Graphical Abstract

Implementation of Chatbot that Predicts an Illness Dynamically using Machine Learning Techniques

Keywords

Main Subjects


  1. Michalski RS, Carbonell JG, Mitchell TM. Machine learning: An artificial intelligence approach: Springer Science & Business Media; 2013.
  2. Liddy ED. Natural language processing. 2001.
  3. Ahangari M, Sebti A. A Hybrid Approach to Sentiment Analysis of Iranian Stock Market User’s Opinions. International Journal of Engineering, Transactions C: Aspects,. 2023;36(3):573-84. 10.5829/IJE.2023.36.03C.18
  4. Harimi A, Esmaileyan Z. A database for automatic Persian speech emotion recognition: collection, processing and evaluation. International Journal of Engineering, Transactions A: Basics,. 2014;27(1):79-90. 10.5829/idosi.ije.2014.27.01a.11
  5. Sadjadi S, Mashayekhi H, Hassanpour H. A two-level semi-supervised clustering technique for news articles. International Journal of Engineering, Transactions C: Aspects,. 2021;34(12):2648-57. 10.5829/IJE.2021.34.12C.10
  6. George AS, George AH, Baskar T, Martin AG. Human Insight AI: An Innovative Technology Bridging The Gap Between Humans And Machines For a Safe, Sustainable Future. Partners Universal International Research Journal. 2023;2(1):1-15. https://doi.org/10.5281/zenodo.7723117
  7. Lalwani T, Bhalotia S, Pal A, Rathod V, Bisen S. Implementation of a Chatbot System using AI and NLP. International Journal of Innovative Research in Computer Science & Technology (IJIRCST) Volume-6, Issue-3. 2018. http://dx.doi.org/10.2139/ssrn.3531782
  8. Athota L, Shukla VK, Pandey N, Rana A, editors. Chatbot for healthcare system using artificial intelligence. 2020 8th International conference on reliability, infocom technologies and optimization (trends and future directions)(ICRITO); 2020: IEEE. 10.1109/ICRITO48877.2020.9197833
  9. Turing AM. Mind. Mind. 1950;59(236):433-60.
  10. Weizenbaum J. ELIZA—a computer program for the study of natural language communication between man and machine. Communications of the ACM. 1966;9(1):36-45. 10.1145/365153.365168
  11. AbuShawar B, Atwell E. ALICE chatbot: Trials and outputs. Computación y Sistemas. 2015;19(4):625-32. 10.13053/cys-19-4-2326
  12. Xu L, Sanders L, Li K, Chow JC. Chatbot for health care and oncology applications using artificial intelligence and machine learning: systematic review. JMIR cancer. 2021;7(4):e27850. 10.2196/27850
  13. Saengrith W, Viriyavejakul C, Pimdee P. Problem-Based Blended Training via Chatbot to Enhance the Problem-Solving Skill in the Workplace. Emerging Science Journal. 2022;6:1-12. 10.28991/ESJ-2022-SIED-01
  14. Mendonça YV, Naranjo PGV, Pinto DC. The Role of Technology in the Learning Process. Emerging Science Journal. 2022;6(Special Issue):280-95. 10.28991/ESJ-2022-SIED-020
  15. Roshani S, Coccia M, Mosleh M. Sensor technology for opening new pathways in diagnosis and therapeutics of breast, lung, colorectal and prostate cancer. medRxiv. 2022:2022.02. 18.22271186. 10.28991/HIJ-2022-03-03-010
  16. Hamidi H, Daraee A. Analysis of pre-processing and post-processing methods and using data mining to diagnose heart diseases. International Journal of Engineering, Transactions A: Basics 2016;29(7):921-30. 10.5829/idosi.ije.2016.29.07a.06
  17. Ye EZ, Ye EH, Bouthillier M, Ye RZ. DeepImageTranslator V2: analysis of multimodal medical images using semantic segmentation maps generated through deep learning. bioRxiv. 2021:2021.10. 12.464160. 10.28991/HIJ-2022-03-03-07
  18. Manjurul Ahsan M, Siddique Z. Machine learning based disease diagnosis: A comprehensive review. arXiv e-prints. 2021:arXiv: 2112.15538.
  19. Shaji SP, editor Predictionand diagnosis of heart disease patients using data mining technique. 2019 international conference on communication and signal processing (ICCSP); 2019: IEEE. 10.1109/ICCSP.2019.8697977
  20. Keniya R, Khakharia A, Shah V, Gada V, Manjalkar R, Thaker T, et al. Disease prediction from various symptoms using machine learning. Available at SSRN 3661426. 2020. http://dx.doi.org/10.2139/ssrn.3661426
  21. Ferjani MF. Disease Prediction Using Machine Learning. Bournemouth, England: Bournemouth University. 2020. 10.13140/RG.2.2.18279.47521
  22. Magoulas GD, Prentza A. Machine learning in medical applications. Advanced course on artificial intelligence: Springer; 1999. p. 300-7.
  23. Jain R, Chotani A, Anuradha G. Disease diagnosis using machine learning: A comparative study. Data Analytics in Biomedical Engineering and Healthcare: Elsevier; 2021. p. 145-61.
  24. Pingale K, Surwase S, Kulkarni V, Sarage S, Karve A. Disease prediction using machine learning. International Research Journal of Engineering and Technology (IRJET). 2019;6(12):831-3.
  25. Bharti U, Bajaj D, Batra H, Lalit S, Lalit S, Gangwani A, editors. Medbot: Conversational artificial intelligence powered chatbot for delivering tele-health after covid-19. 2020 5th international conference on communication and electronics systems (ICCES); 2020: IEEE. 10.1109/ICCES48766.2020.9137944
  26. Tjiptomongsoguno ARW, Chen A, Sanyoto HM, Irwansyah E, Kanigoro B. Medical chatbot techniques: a review. Software Engineering Perspectives in Intelligent Systems: Proceedings of 4th Computational Methods in Systems and Software 2020, Vol 1 4. 2020:346-56. 10.1007/978-3-030-63322-6_28
  27. Reshma R, editor An Improved Chatbot for Medical Assistance using Machine Learning. 2022 International Conference on Inventive Computation Technologies (ICICT); 2022: IEEE. 10.1109/ICICT54344.2022.9850470
  28. Prayitno PI, Leksono RPP, Chai F, Aldy R, Budiharto W, editors. Health Chatbot Using Natural Language Processing for Disease Prediction and Treatment. 2021 1st International Conference on Computer Science and Artificial Intelligence (ICCSAI); 2021: IEEE. 10.1109/ICCSAI53272.2021.9609784
  29. Ayanouz S, Abdelhakim BA, Benhmed M, editors. A smart chatbot architecture based NLP and machine learning for health care assistance. Proceedings of the 3rd international conference on networking, information systems & security; 2020.
  30. Caldarini G, Jaf S, McGarry K. A literature survey of recent advances in chatbots. Information. 2022;13(1):41. https://doi.org/10.3390/info13010041
  31. Kumar R, Ali MM. A review on chatbot design and implementation techniques. Int J Eng Technol. 2020;7(11).
  32. Chaudhary J, Joshi V, Khare A, Gawali R, Manna A. A Comparative Study of Medical Chatbots. International Research Journal of Engineering and Technology (IRJET). 2021;8(02).
  33. Vasileiou MV, Maglogiannis IG. The Health ChatBots in Telemedicine: Intelligent Dialog System for Remote Support. Journal of Healthcare Engineering. 2022;2022. https://doi.org/10.1155/2022/4876512
  34. Shaikh A, More D, Puttoo R, Shrivastav S, Shinde S. A survey paper on chatbots. International Research Journal of Engineering and Technology (IRJET). 2019;6(04):2395-0072.
  35. PhaniRaghavaa B, Kumarb SA. An Improved Chatbot for Predicting Disease and Medicines Using Natural Language Processing with Fuzzy Logic. Advances in Parallel Computing Algorithms, Tools and Paradigms. 2022;41:258. 10.3233/APC220035
  36. Amer E, Hazem A, Farouk O, Louca A, Mohamed Y, Ashraf M, editors. A proposed chatbot framework for COVID-19. 2021 International Mobile, Intelligent, and Ubiquitous Computing Conference (MIUCC); 2021: IEEE. 10.1109/MIUCC52538.2021.9447652
  37. Kumar A, Sharma GK, Prakash U. Disease prediction and doctor recommendation system using machine learning approaches. International Journal for Research in Applied Science & Engineering Technology (IJRASET). 2021;9:34-44. https://doi.org/10.2214/ijraset.20221.36234
  38. Tamizharasi B, Livingston LJ, Rajkumar S, editors. Building a medical chatbot using support vector machine learning algorithm. Journal of Physics: Conference Series; 2020: IOP Publishing. 10.1088/1742-6596/1716/1/012059
  39. Giansanti D. The Chatbots Are Invading Us: A Map Point on the Evolution, Applications, Opportunities, and Emerging Problems in the Health Domain. Life. 2023;13(5):1130. https://doi.org/10.3390/life13051130
  40. Wilson L, Marasoiu M. The development and use of chatbots in public health: scoping review. JMIR human factors. 2022;9(4):e35882. 10.2196/35882
  41. Fooladi S, Farsi H, Mohamadzadeh S. Segmenting the lesion area of brain tumor using convolutional neural networks and fuzzy k-means clustering. International Journal of Engineering, Transaction B: Applications. 2023;36(8):1556-68. 10.5829/IJE.2023.36.08B.15
  42. Pourbahrami S, Balafar MA, Khanli LM, Kakarash ZA. A survey of neighborhood construction algorithms for clustering and classifying data points. Computer Science Review. 2020;38:100315. https://doi.org/10.1016/j.cosrev.2020.100315
  43. Kakarash ZA, Mardukhia F, Moradi P. Multi-label feature selection using density-based graph clustering and ant colony optimization. Journal of Computational Design and Engineering. 2023;10(1):122-38. https://doi.org/10.1093/jcde/qwac120