PERTANIKA JOURNAL OF SCIENCE AND TECHNOLOGY

 

e-ISSN 2231-8526
ISSN 0128-7680

Home / Regular Issue / JST Vol. 31 (5) Aug. 2023 / JST-3632-2022

 

Super-Resolution Approach to Enhance Bone Marrow Trephine Image in the Classification of Classical Myeloproliferative Neoplasms

Umi Kalsom Mohamad Yusof, Syamsiah Mashohor, Marsyita Hanafi, Sabariah Md Noor and Norsafina Zainal

Pertanika Journal of Science & Technology, Volume 31, Issue 5, August 2023

DOI: https://doi.org/10.47836/pjst.31.5.02

Keywords: Artificial intelligence, histopathology images, image reconstruction, myeloproliferative neoplasm, super-resolution

Published on: 31 July 2023

Many diseases require histopathology images to characterise biological components or study cell and tissue architectures. The histopathology images are also essential in supporting disease classification, including myeloproliferative neoplasms (MPN). Despite significant developments to improve the diagnostic tools, morphological assessment from histopathology images obtained by bone marrow trephine (BMT) remains crucial to confirm MPN subtypes. However, the assessment outcome is challenging due to subjective characteristics that are hard to replicate due to its inter-observer variability. Apart from that, image processing may reduce the quality of the BMT images and affect the diagnosis result. This study has developed a classification system for classical MPN subtypes: polycythemia vera (PV), essential thrombocythemia (ET), and primary myelofibrosis (MF). It was done by reconstructing low-resolution images of BMT using a super-resolution approach to address the issue. Identified low-resolution images from calculating Laplacian variance were reconstructed using a super-resolution convolution neural network (SRCNN) to transform into rich information of high-resolution images. Original BMT images and reconstructed BMT images using the SRCNN dataset were fed into a CNN classifier, and the classifier’s output for both datasets was compared accordingly. Based on the result, the dataset consisting of the reconstructed images showed better output with 92% accuracy, while the control images gave 88% accuracy. In conclusion, the high quality of histopathology images substantially impacts disease process classification, and the reconstruction of low-resolution images has improved the classification output.

  • Ali, U., & Mahmood, M. T. (2018). Analysis of blur measure operators for single image blur segmentation. Applied Sciences, 8(5), Article 807. https://doi.org/10.3390/app8050807

  • Alzubaidi, L., Zhang, J., Humaidi, A. J., Al-Dujaili, A., Duan, Y., Al-Shamma, O., Santamaría, J., Fadhel, M. A., Al-Amidie, M., & Farhan, L. (2021). Review of deep learning: concepts, CNN architectures, challenges, applications, future directions. Journal of Big Data, 8, Article 53. https://doi.org/10.1186/s40537-021-00444-8

  • Arber, D. A., Orazi, A., Hasserjian, R., Thiele, J., Borowitz, M. J., Le Beau, M. M., Bloomfield, C. D., Cazzola, M., & Vardiman, J. W. (2016). The 2016 revision to the World Health Organization classification of myeloid neoplasms and acute leukemia. Blood, 127(20), 2391-2405. https://doi.org/10.1182/blood-2016-03-643544

  • Barbui, T., Thiele, J., Gisslinger, H., Kvasnicka, H. M., Vannucchi, A. M., Guglielmelli, P., Orazi, A., & Tefferi, A. (2018). The 2016 WHO classification and diagnostic criteria for myeloproliferative neoplasms: document summary and in-depth discussion. Blood Cancer Journal, 8, Article 15. https://doi.org/10.1038/s41408-018-0054-y

  • Chen, Y., Wang, J., Chen, X., Sangaiah, A. K., Yang, K., & Cao, Z. (2019). Image super-resolution algorithm based on dual-channel convolutional neural networks. Applied Sciences, 9(11), Article 2316. https://doi.org/10.3390/app9112316 (Retraction published 2021, Applied Sciences, 11(20), Article 9442)

  • Cheng, Z., Sun, H., Takeuchi, M., & Katto, J. (2018). Performance comparison of convolutional autoencoders, generative adversarial networks and super-resolution for image compression. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 2613-2616). Computer Vision Foundation. https://doi.org/10.48550/arXiv.1807.00270

  • Dameshek, W. (1951). Some speculations on the myeloproliferative syndromes. Blood, 6(4), 372-375. https://doi.org/10.2307/j.ctvcszzbq.35

  • Dodge, S., & Karam, L. (2016). Understanding how image quality affects deep neural networks. In 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX) (pp. 1-6). IEEE Publishing. https://doi.org/10.1109/QoMEX.2016.7498955

  • Hasserjian, R. P. (2018). Changes in the World Health Organization 2016 classification of myeloid neoplasms everyone should know. Current Opinion in Hematology, 25(2), 120-128. https://doi.org/10.1097/MOH.0000000000000404

  • Hayat, K. (2018). Multimedia super-resolution via deep learning: A survey. Digital Signal Processing, 81, 198-217. https://doi.org/10.1016/j.dsp.2018.07.005

  • Hou, J., Si, Y., & Yu, X. (2020). A novel and effective image super-resolution reconstruction technique via fast global and local residual learning model. Applied Sciences, 10(5), Article 1856. https://doi.org/10.3390/app10051856

  • Huang, R., Feng, W., Fan, M., Wan, L., & Sun, J. (2018). Multiscale blur detection by learning discriminative deep features. Neurocomputing, 285, 154-166. https://doi.org/10.1016/j.neucom.2018.01.041

  • Jain, P. A., & Kosamkar, P. K. (2022). Analysis and prediction of COVID-19 with image super-resolution using CNN and SRCNN-Based approach. In T. Senjyu, P. N. Mahalle, T. Perumal & A. Joshi (Eds.), Smart Innovation, Systems and Technologies: Vol. 248. ICT with Intelligent Applications (pp. 33-40). Springer. https://doi.org/10.1007/978-981-16-4177-0_5

  • Leena, M. F., & Sreenath, N. (2019). Pre-processing techniques for detection of blurred images. In N. Chaki, N. Devarakonda, A. Sarkar & N. Debnath (Eds.). Lecture Notes on Data Engineering and Communications Technologies: Vol. 28. Proceedings of International Conference on Computational Intelligence and Data Engineering (pp. 59-66). Springer. https://doi.org/10.1007/978-981-13-6459-4_7

  • Loey, M., Naman, M., & Zayed, H. (2020). Deep transfer learning in diagnosing leukemia in blood cells. Computers, 9(2), Article 29. https://doi.org/10.3390/computers9020029

  • Mariam, K., Afzal, O. M., Hussain, W., Javed, M. U., Kiyani, A., Rajpoot, N., Khurram, S. A., & Khan, H. A. (2022). On smart gaze based annotation of histopathology images for training of deep convolutional neural networks. IEEE Journal of Biomedical and Health Informatics, 26(7), 3025-3036. https://doi.org/10.1109/JBHI.2022.3148944

  • Parsania, P. S., & Virparia, P. V. (2016). A comparative analysis of image interpolation algorithms. International Journal of Advanced Research in Computer and Communication Engineering, 5(1), 29-34. https://doi.org/10.17148/ijarcce.2016.5107

  • Rahaman, M. A., Chen, J., Fu, Z., Lewis, N., Iraji, A., & Calhoun, V. D. (2021). Multi-modal deep learning of functional and structural neuroimaging and genomic data to predict mental illness. In 2021 43rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (pp. 3267-3272). IEEE Publishing. https://doi.org/10.1109/EMBC46164.2021.9630693

  • Sirinukunwattana, K., Aberdeen, A., Theissen, H., Sousos, N., Psaila, B., Mead, A. J., Turner, G. D. H., Rees, G., Rittscher, J., & Royston, D. (2019). Improving the diagnosis and classification of ph-negative myeloproliferative neoplasms through deep phenotyping. BioRxiv. https://doi.org/10.1101/762013

  • Talo, M. (2019). Automated classification of histopathology images using transfer learning. Artificial Intelligence in Medicine, 101, Article 101743. https://doi.org/10.1016/j.artmed.2019.101743

  • Taş, M., & Yılmaz, B. (2021). Super resolution convolutional neural network based pre-processing for automatic polyp detection in colonoscopy images. Computers and Electrical Engineering, 90, Article 106969. https://doi.org/10.1016/j.compeleceng.2020.106959

  • Tavares, R. S., Nonino, A., Pagnano, K. B. B., Nascimento, A. C. K. V. d, Conchon, M., Fogliatto, L. M., Funke, V. A. M., Bendit, I., Clementino, N. C. D., Chauffaille, M. d. L. L. F., Bernardo, W. M., & de Souza Santos, F. P. (2019). Guideline on myeloproliferative neoplasms: Associacão Brasileira de Hematologia, Hemoterapia e Terapia Cellular: Project guidelines: Associação Médica Brasileira - 2019. Hematology, Transfusion and Cell Therapy, 41(Supplement 1), 1-73. https://doi.org/10.1016/j.htct.2019.03.001

  • Umehara, K., Ota, J., & Ishida, T. (2018). Application of super-resolution convolutional neural network for enhancing image resolution in chest CT. Journal of Digital Imaging, 31, 441-450. https://doi.org/10.1007/s10278-017-0033-z

  • Vannucchi, A. M., & Harrison, C. N. (2017). Emerging treatments for classical myeloproliferative neoplasms. Blood, 129(6), 693-703. https://doi.org/10.1182/blood-2016-10-695965

  • Vasudevan, S., Saha, A., Tarver, M. E., & Patel, B. (2022). Digital biomarkers: Convergence of digital health technologies and biomarkers. Npj Digital Medicine, 5, Article 36. https://doi.org/10.1038/s41746-022-00583-z

  • Zhang, H. M., & Dong, B. (2020). A review on deep learning in medical image reconstruction. Journal of the Operations Research Society of China, 8, 311-340. https://doi.org/10.1007/s40305-019-00287-4

  • Zhang, J., Shao, M., Yu, L., & Li, Y. (2020). Image super-resolution reconstruction based on sparse representation and deep learning. Signal Processing: Image Communication, 87, Article 115925. https://doi.org/10.1016/j.image.2020.115925