COVED: A Hardware Accelerated Soft Computing Enabled Intelligent Value Chain Based Diagnostic Automation for nCOVID-19 Estimation and Identification
DOI:
https://doi.org/10.6000/1929-6029.2021.10.14Keywords:
Artificial Intelligence, Internet of Things, Deep Learning, Machine Learning, COVID-19 Detection, HRCT, Pathology Data, Stage Classification COVID-19, Raspberry Pi, Intel® Movidius™, Neural Compute StickAbstract
Purpose: COVID-19, a global pandemic, first appeared in the city of Wuhan, China, and has since spread differently across geographical borders, classes, and genders from various age groups, sometimes mutating its DNA strands in the process. The sheer magnitude of the pandemic's spread is putting a strain on hospitals and medical facilities. The need of the hour is to deploy IoT devices and robots to monitor patients' body vitals as well as their other pathological data to further control the spread. There has not been a more compelling need to use digital advances to remotely provide quality healthcare via computing devices and AI-powered medical aids.
Method: This research developed a deployable Internet of Things (IoT) based infrastructure for the early and simple detection and isolation of suspected coronavirus patients, which was accomplished via the use of ensemble deep transfer learning. The proposed Internet of Things framework combines 4 different deep learning models: DenseNet201, VGG16, InceptionResNetV2, and ResNet152V2. Utilizing the deep ensemble model, the medical modalities are used to obtain chest high-resolution computed tomography (HRCT) images and diagnose the infection.
Results: Over the HRCT image dataset, the developed deep ensemble model is collated to different state-of-the-art transfer learning (TL) models. The comparative investigation demonstrated that the suggested approach can aid radiologists inefficiently and swiftly diagnosing probable coronavirus patients.
Conclusion: For the first time, our group has developed an AI-enabled Decision Support System to automate the entire process flow from estimation to detection of COVID-19 subjects as part of an Intelligent Value Chain algorithm. The screening is expected to eliminate the false negatives and asymptomatic ones out of the equation and hence the affected individuals could be identified in a total process time of 15 minutes to 1 hour. A Complete Deployable System with AI Influenced Prediction is described here for the first time. Not only did the authors suggest a Multiple Hypothesis based Decision Fusion Algorithm for forecasting the outcome, but they also did the predictive analytics. For simple confined isolation or hospitalization, this complete Predictive System was encased within an IoT ecosystem.
References
Akan OB, Andreev S, Dobre C. Internet of things and sensor Networks. IEEE Communications Magazine 2019; 57(2): 40. https://doi.org/10.1109/MCOM.2019.8647109 DOI: https://doi.org/10.1109/MCOM.2019.8647109
Runkler TA. Data Visualization. Data Analytics. Springer; 2020; pp. 37-59. https://doi.org/10.1007/978-3-658-29779-4_4 DOI: https://doi.org/10.1007/978-3-658-29779-4_4
Ebadi A, Xi P, Tremblay S, Spencer B, Pall R, Wong A. Understanding the temporal evolution of COVID-19 research through machine learning and natural language processing. Scientometrics 2021; 126(1): 725-39. https://doi.org/10.1007/s11192-020-03744-7 DOI: https://doi.org/10.1007/s11192-020-03744-7
Gubala V, Harris LF, Ricco AJ, Tan MX, Williams DE. Point of care diagnostics: status and future. Analytical chemistry 2012; 84(2): 487-515. https://doi.org/10.1021/ac2030199 DOI: https://doi.org/10.1021/ac2030199
Yuehong Y, Zeng Y, Chen X, Fan Y. The internet of things in healthcare: An overview. Journal of Industrial Information Integration 2016; 1: 3-13. https://doi.org/10.1016/j.jii.2016.03.004 DOI: https://doi.org/10.1016/j.jii.2016.03.004
Farahani B, Firouzi F, Chakrabarty K. Healthcare iot. Intelligent Internet of Things. Springer 2020; pp. 515-45. https://doi.org/10.1007/978-3-030-30367-9_11 DOI: https://doi.org/10.1007/978-3-030-30367-9_11
Chakraborty I, Maity P. COVID-19 outbreak: Migration, effects on society, global environment and prevention. Science of the Total Environment 2020; 728: 138882. https://doi.org/10.1016/j.scitotenv.2020.138882 DOI: https://doi.org/10.1016/j.scitotenv.2020.138882
Afzal A. Molecular diagnostic technologies for COVID-19: Limitations and challenges. Journal of Advanced Research 2020. https://doi.org/10.1016/j.jare.2020.08.002 DOI: https://doi.org/10.1016/j.jare.2020.08.002
Horry MJ, Chakraborty S, Paul M, Ulhaq A, Pradhan B, Saha M, et al. COVID-19 detection through transfer learning using multimodal imaging data. IEEE Access 2020; 8: 149808-24. https://doi.org/10.1109/ACCESS.2020.3016780 DOI: https://doi.org/10.1109/ACCESS.2020.3016780
Ho TKK, Gwak J, Prakash O, Song J-I, Park CM. Utilizing pretrained deep learning models for automated pulmonary tuberculosis detection using chest radiography. Asian conference on intelligent information and database systems: Springer 2019; pp. 395-403. https://doi.org/10.1007/978-3-030-14802-7_34 DOI: https://doi.org/10.1007/978-3-030-14802-7_34
Narin A, Kaya C, Pamuk Z. Automatic detection of coronavirus disease (covid-19) using x-ray images and deep convolutional neural networks. Pattern Analysis and Applications 2021; 1-14. https://doi.org/10.1007/s10044-021-00984-y DOI: https://doi.org/10.1007/s10044-021-00984-y
Abbas A, Abdelsamea MM, Gaber MM. Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network. Applied Intelligence 2021; 51(2): 854-64. https://doi.org/10.1007/s10489-020-01829-7 DOI: https://doi.org/10.1007/s10489-020-01829-7
Ahmed I, Ahmad A, Jeon G. An iot based deep learning framework for early assessment of covid-19. IEEE Internet of Things Journal 2020. https://doi.org/10.1109/JIOT.2020.3034074 DOI: https://doi.org/10.1109/JIOT.2020.3034074
Chowdhury ME, Rahman T, Khandakar A, Mazhar R, Kadir MA, Mahbub ZB, et al. Can AI help in screening viral and COVID-19 pneumonia? IEEE Access 2020; 8: 132665-76. https://doi.org/10.1109/ACCESS.2020.3010287 DOI: https://doi.org/10.1109/ACCESS.2020.3010287
Han Z, Wei B, Hong Y, Li T, Cong J, Zhu X, et al. Accurate screening of COVID-19 using attention- based deep 3D multiple instance learning. IEEE Transactions on Medical Imaging 2020; 39(8): 2584-94. https://doi.org/10.1109/TMI.2020.2996256 DOI: https://doi.org/10.1109/TMI.2020.2996256
Qian X, Fu H, Shi W, Chen T, Fu Y, Shan F, et al. M $^ 3$ Lung-Sys: A Deep Learning System for Multi-Class Lung Pneumonia Screening From CT Imaging. IEEE Journal of Biomedical and Health Informatics 2020; 24(12): 3539-50. https://doi.org/10.1109/JBHI.2020.3030853 DOI: https://doi.org/10.1109/JBHI.2020.3030853
Zhang J, Xie Y, Pang G, Liao Z, Verjans J, Li W, et al. Viral pneumonia screening on chest X-ray images using confidence-aware anomaly detection. arXiv preprint arXiv: 200312338 2020.
Wang L, Lin ZQ, Wong A. Covid-net: A tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images. Scientific Reports 2020; 10(1): 1-12. https://doi.org/10.1038/s41598-020-76550-z DOI: https://doi.org/10.1038/s41598-020-76550-z
Makris A, Kontopoulos I, Tserpes K. COVID-19 detection from chest X-Ray images using Deep Learning and Convolutional Neural Networks. 11th Hellenic Conference on Artificial Intelligence 2020; pp. 60-6. https://doi.org/10.1145/3411408.3411416 DOI: https://doi.org/10.1145/3411408.3411416
Sakib S, Tazrin T, Fouda MM, Fadlullah ZM, Guizani M. DL-CRC: deep learning-based chest radiograph classification for COVID-19 detection: a novel approach. IEEE Access 2020; 8: 171575-89. https://doi.org/10.1109/ACCESS.2020.3025010 DOI: https://doi.org/10.1109/ACCESS.2020.3025010
Farooq M, Hafeez A. Covid-resnet: A deep learning framework for screening of covid19 from radiographs. arXiv preprint arXiv: 200314395 2020.
Waheed A, Goyal M, Gupta D, Khanna A, Al-Turjman F, Pinheiro PR. Covidgan: data augmentation using auxiliary classifier gan for improved covid-19 detection. IEEE Access 2020; 8: 91916-23. https://doi.org/10.1109/ACCESS.2020.2994762 DOI: https://doi.org/10.1109/ACCESS.2020.2994762
Gianchandani N, Jaiswal A, Singh D, Kumar V, Kaur M. Rapid COVID-19 diagnosis using ensemble deep transfer learning models from chest radiographic images. Journal of Ambient Intelligence and Humanized Computing 2020; 1-13. https://doi.org/10.1007/s12652-020-02669-6 DOI: https://doi.org/10.1007/s12652-020-02669-6
Singh D, Kumar V, Yadav V, Kaur M. Deep neural network-based screening model for COVID-19- infected patients using chest X-ray images. International Journal of Pattern Recognition and Artificial Intelligence 2021; 35(03): 2151004. https://doi.org/10.1142/S0218001421510046 DOI: https://doi.org/10.1142/S0218001421510046
Singh D, Kumar V, Kaur M. Densely connected convolutional networks-based COVID-19 screening model. Applied Intelligence 2021; 51(5): 3044-51. https://doi.org/10.1007/s10489-020-02149-6 DOI: https://doi.org/10.1007/s10489-020-02149-6
Apostolopoulos ID, Mpesiana TA. Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Physical and Engineering Sciences in Medicine 2020; 43(2): 635-40. https://doi.org/10.1007/s13246-020-00865-4 DOI: https://doi.org/10.1007/s13246-020-00865-4
Basavegowda HS, Dagnew G. Deep learning approach for microarray cancer data classification. CAAI Trans Intell Technol 2020; 5(1): 22-33. https://doi.org/10.1049/trit.2019.0028 DOI: https://doi.org/10.1049/trit.2019.0028
Ghosh S, Shivakumara P, Roy P, Pal U, Lu T. Graphology based handwritten character analysis for human behaviour identification. CAAI Trans Intell Technol 2020; 5(1): 55-65. https://doi.org/10.1049/trit.2019.0051 DOI: https://doi.org/10.1049/trit.2019.0051
Gupta B, Tiwari M, Lamba SS. Visibility improvement and mass segmentation of mammogram images using quantile separated histogram equalisation with local contrast enhancement. CAAI Transactions on Intelligence Technology 2019; 4(2): 73-9. https://doi.org/10.1049/trit.2018.1006 DOI: https://doi.org/10.1049/trit.2018.1006
Brihn A, Chang J, OYong K, Balter S, Terashita D, Rubin Z, et al. Diagnostic Performance of an Antigen Test with RT-PCR for the Detection of SARS-CoV-2 in a Hospital Setting—Los Angeles County, California, June–August 2020. Morbidity and Mortality Weekly Report 2021; 70(19): 702. https://doi.org/10.15585/mmwr.mm7019a3 DOI: https://doi.org/10.15585/mmwr.mm7019a3
Shakouri S, Bakhshali MA, Layegh P, Kiani B, Masoumi F, Nakhaei SA, et al. COVID19-CT-dataset: an open-access
chest CT image repository of 1000+ patients with confirmed COVID-19 diagnosis. BMC Research Notes 2021; 14(1): 1-3. https://doi.org/10.1186/s13104-021-05592-x DOI: https://doi.org/10.1186/s13104-021-05592-x
Loussaief S, Abdelkrim A. Deep learning vs. bag of features in machine learning for image classification 2018 International Conference on Advanced Systems and Electric Technologies (IC_ASET): IEEE 2018; pp. 6-10. https://doi.org/10.1109/ASET.2018.8379825 DOI: https://doi.org/10.1109/ASET.2018.8379825
Schapire RE. Explaining adaboost. Empirical inference. Springer 2013; pp. 37-52. https://doi.org/10.1007/978-3-642-41136-6_5 DOI: https://doi.org/10.1007/978-3-642-41136-6_5
Seiffert C, Khoshgoftaar TM, Van Hulse J, Napolitano A. RUSBoost: Improving classification performance when training data is skewed 2008 19th International Conference on Pattern Recognition: IEEE 2008; pp. 1-4. https://doi.org/10.1109/ICPR.2008.4761297 DOI: https://doi.org/10.1109/ICPR.2008.4761297
Guan W-J, Ni Z-Y, Hu Y, Liang W-H, Ou C-Q, He J-X, et al. Clinical characteristics of coronavirus disease 2019 in China. New England Journal of Medicine 2020; 382(18): 1708-20. https://doi.org/10.1056/NEJMoa2002032 DOI: https://doi.org/10.1056/NEJMoa2002032
Chen N, Zhou M, Dong X, Qu J, Gong F, Han Y, et al. Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study. The Lancet 2020; 395(10223): 507-13. https://doi.org/10.1016/S0140-6736(20)30211-7 DOI: https://doi.org/10.1016/S0140-6736(20)30211-7
Simpson S, Kay FU, Abbara S, Bhalla S, Chung JH, Chung M, et al. Radiological society of north America expert consensus document on reporting chest CT findings related to COVID-19: endorsed by the society of thoracic Radiology, the American college of Radiology, and RSNA. Radiology: Cardiothoracic Imaging 2020; 2(2): e200152. https://doi.org/10.1148/ryct.2020200152 DOI: https://doi.org/10.1148/ryct.2020200152
Ritschard G. Computing and using the deviance with classification trees. COMPSTAT 2006- Proceedings in Computational Statistics. Springer 2006; pp. 55-66. https://doi.org/10.1007/978-3-7908-1709-6_5 DOI: https://doi.org/10.1007/978-3-7908-1709-6_5
Kayri M, Kayri İ. The comparison of Gini and Twoing algorithms in terms of predictive ability and misclassification cost in data mining: an empirical study. Databases 2015; 3: 5. https://doi.org/10.14445/22312803/IJCTT-V27P105 DOI: https://doi.org/10.14445/22312803/IJCTT-V27P105
Baczkowski A, Joanes D, Shamia G. The distribution of a generalized diversity index due to Good. Environmental and Ecological Statistics 2000; 7(4): 329-42. https://doi.org/10.1023/A:1026567414861 DOI: https://doi.org/10.1023/A:1026567414861
Shih K-H, Chiu C-T, Lin J-A, Bu Y-Y. Real-time object detection with reduced region proposal network via multi-feature concatenation. IEEE Transactions on Neural Networks and Learning Systems 2019; 31(6): 2164-73. https://doi.org/10.1109/TNNLS.2019.2929059 DOI: https://doi.org/10.1109/TNNLS.2019.2929059
Zhou Y, Li G, Li H. Automatic cataract classification using deep neural network with discrete state transition. IEEE Transactions on Medical Imaging 2019; 39(2): 436-46. https://doi.org/10.1109/TMI.2019.2928229 DOI: https://doi.org/10.1109/TMI.2019.2928229
Yang W, Cao Q, Qin L, Wang X, Cheng Z, Pan A, et al. Clinical characteristics and imaging manifestations of the 2019 novel coronavirus disease (COVID-19): a multi-center study in Wenzhou city, Zhejiang, China. Journal of Infection 2020; 80(4): 388-93. https://doi.org/10.1016/j.jinf.2020.02.016 DOI: https://doi.org/10.1016/j.jinf.2020.02.016
Yoon SH, Lee KH, Kim JY, Lee YK, Ko H, Kim KH, et al. Chest radiographic and CT findings of the 2019 novel coronavirus disease (COVID-19): analysis of nine patients treated in Korea. Korean Journal of Radiology 2020; 21(4): 494. https://doi.org/10.3348/kjr.2020.0132 DOI: https://doi.org/10.3348/kjr.2020.0132
Rodrigues J, Hare S, Edey A, Devaraj A, Jacob J, Johnstone A, et al. An update on COVID-19 for the radiologist-A British society of Thoracic Imaging statement. Clinical Radiology 2020; 75(5): 323-5. https://doi.org/10.1016/j.crad.2020.03.003 DOI: https://doi.org/10.1016/j.crad.2020.03.003
Ludvigsson JF. Systematic review of COVID‐19 in children shows milder cases and a better prognosis than adults. Acta Paediatrica 2020; 109(6): 1088-95. https://doi.org/10.1111/apa.15270 DOI: https://doi.org/10.1111/apa.15270
Holshue ML, DeBolt C, Lindquist S, Lofy KH, Wiesman J, Bruce H, et al. First case of 2019 novel coronavirus in the United States. New England Journal of Medicine 2020. https://doi.org/10.1056/NEJMoa2001191 DOI: https://doi.org/10.1056/NEJMoa2001191
Yang R, Li X, Liu H, Zhen Y, Zhang X, Xiong Q, et al. Chest CT severity score: an imaging tool for assessing severe COVID-19. Radiology: Cardiothoracic Imaging 2020; 2(2): e200047. https://doi.org/10.1148/ryct.2020200047 DOI: https://doi.org/10.1148/ryct.2020200047
Zhang W, Thurow K, Stoll R. A knowledge-based telemonitoring platform for application in remote healthcare. International Journal of Computers Communications & Control 2014; 9(5): 644-54. https://doi.org/10.15837/ijccc.2014.5.661 DOI: https://doi.org/10.15837/ijccc.2014.5.661
Dong J, Zhuang D, Huang Y, Fu J. Advances in multi-sensor data fusion: Algorithms and applications. Sensors 2009; 9(10): 7771-84. https://doi.org/10.3390/s91007771 DOI: https://doi.org/10.3390/s91007771
Gevaert CM, García-Haro FJ. A comparison of STARFM and an unmixing-based algorithm for Landsat and MODIS data fusion. Remote Sensing of Environment 2015; 156: 34-44. https://doi.org/10.1016/j.rse.2014.09.012 DOI: https://doi.org/10.1016/j.rse.2014.09.012
Fourati H. Heterogeneous data fusion algorithm for pedestrian navigation via foot-mounted inertial measurement unit and complementary filter. IEEE Transactions on Instrumentation and Measurement 2014; 64(1): 221-9. https://doi.org/10.1109/TIM.2014.2335912 DOI: https://doi.org/10.1109/TIM.2014.2335912
Ambühl L, Menendez M. Data fusion algorithm for macroscopic fundamental diagram estimation. Transportation Research Part C: Emerging Technologies 2016; 71: 184-97. https://doi.org/10.1016/j.trc.2016.07.013 DOI: https://doi.org/10.1016/j.trc.2016.07.013
Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE international conference on computer vision 2017; pp. 618-26. https://doi.org/10.1109/ICCV.2017.74 DOI: https://doi.org/10.1109/ICCV.2017.74
Downloads
Published
How to Cite
Issue
Section
License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Policy for Journals/Articles with Open Access
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are permitted and encouraged to post links to their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work
Policy for Journals / Manuscript with Paid Access
Authors who publish with this journal agree to the following terms:
- Publisher retain copyright .
- Authors are permitted and encouraged to post links to their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work .
