Automatic identification of herbal medicines using deep learning on leaf images

(1) * Anita Ahmad Kasim Mail (Universitas Tadulako, Indonesia)
(2) Lukman Nadjamudiin Mail (Universitas Tadulako, Indonesia)
(3) Muhammad Bakri Mail (Universitas Tadulako, Indonesia)
(4) Chairunnisa Ardiansyah Lamasitudju Mail (Universitas Tadulako, Indonesia)
(5) Harry Tanni Pagiu Mail (Tadulako University, Indonesia)
(6) Puguh Budi Prakoso Mail (Universitas Lambung Mangkurat, Indonesia)
(7) Anindita Septiarini Mail (Universitas Mulawarman, Indonesia)
(8) Bima Prihasto Mail (Institut Teknologi Kalimantan, Indonesia)
*corresponding author

Abstract


Indonesia has a high diversity of medicinal plants that are widely used in traditional healthcare practices. Identification of medicinal plants is commonly based on leaf morphology; however, similarities in leaf shape, texture, and color often cause misidentification, particularly among non-experts. This limitation highlights the need for an automated and reliable identification approach. The primary objective of this study is to develop and evaluate a deep learning–based system for the automatic identification of medicinal plants using leaf images, with a specific focus on comparing the performance and efficiency of MobileNetV2 and ResNet50V2 architectures. The research design adopts an experimental approach using an internally collected dataset of medicinal plant leaf images representing multiple plant classes. The dataset is divided into training and testing sets to evaluate model generalization. The methodology involves image preprocessing steps, including resizing, normalization, and data augmentation, followed by the application of transfer learning using MobileNetV2 and ResNet50V2 as feature extractors. Both models are trained under the same experimental settings and evaluated using standard classification metrics, including accuracy, precision, recall, F1-score, and confusion matrix analysis. The main outcomes and results indicate that both deep learning models achieve high classification performance. MobileNetV2 achieves an accuracy of 98.77%, precision of 98.84%, recall of 98.77%, and F1-score of 98.77%, while ResNet50V2 achieves an accuracy of 97.53%, precision of 97.87%, recall of 97.53%, and F1-score of 97.58%. The results demonstrate that MobileNetV2 provides slightly superior performance with lower computational complexity. In conclusion, lightweight deep learning architectures such as MobileNetV2 are effective and efficient for medicinal plant leaf identification and are suitable for implementation in mobile or resource-constrained environments.

Keywords


Deep Learning;Automatic;Herbal Medicine;Medical;Leaf Images

   

DOI

https://doi.org/10.26555/ijain.v12i2.2024
      

Article metrics

Abstract views : 220 | PDF views : 5

   

Cite

   

Full Text

Download

References


[1] N. A. M. Roslan, N. M. Diah, Z. Ibrahim, Y. Munarko, and A. E. Minarno, “Automatic plant recognition using convolutional neural network on malaysian medicinal herbs: the value of data augmentation,” Int. J. Adv. Intell. Informatics, vol. 9, no. 1, p. 136, Mar. 2023, doi: 10.26555/ijain.v9i1.1076.

[2] N. Mansouri, H. Guessmi, and A. Alkhalil, “A deep learning model for detection and classification of coffee-leaf diseases using the transfer-learning technique,” Int. J. Adv. Intell. Informatics, vol. 10, no. 3, p. 379, Aug. 2024, doi: 10.26555/ijain.v10i3.1573.

[3] I. Agustian, R. Faurina, S. I. Ishak, F. P. Utama, K. D. Dinata, and N. Daratha, “Deep learning pest detection on Indonesian red chili pepper plant based on fine-tuned YOLOv5,” Int. J. Adv. Intell. Informatics, vol. 9, no. 3, p. 383, Oct. 2023, doi: 10.26555/ijain.v9i3.864.

[4] J. Videira, P. D. Gaspar, V. N. da G. de J. Soares, and J. M. L. P. Caldeira, “Detecting and monitoring the development stages of wild flowers and plants using computer vision: approaches, challenges and opportunities,” Int. J. Adv. Intell. Informatics, vol. 9, no. 3, p. 347, Oct. 2023, doi: 10.26555/ijain.v9i3.1012.

[5] S. Salsabila, A. Suharso, and P. Purwantoro, “Comparison of Deep Learning Architectures in Identifying Types of Medicinal Plant Leaf Images,” J. Appl. Informatics Comput., vol. 8, no. 1, pp. 39–46, Jul. 2024, doi: 10.30871/jaic.v8i1.6289.

[6] U. Khaira, E. Saputra, and A. Adriadi, “I-NusaPlant Apps : Indonesian Medical Plants Identification Using Convolutional Neural Network With Pre-trained Model MobileNetV2,” J. Ilmu Komput. dan Agri-Informatika, vol. 11, no. 2, pp. 185–194, Nov. 2024, doi: 10.29244/jika.11.2.185-194.

[7] B. Dey, J. Ferdous, R. Ahmed, and J. Hossain, “Assessing deep convolutional neural network models and their comparative performance for automated medicinal plant identification from leaf images,” Heliyon, vol. 10, no. 1, p. e23655, Jan. 2024, doi: 10.1016/j.heliyon.2023.e23655.

[8] J. Yao, S. N. Tran, S. Garg, and S. Sawyer, “Deep Learning for Plant Identification and Disease Classification from Leaf Images: Multi-prediction Approaches,” ACM Comput. Surv., vol. 56, no. 6, pp. 1–37, Jun. 2024, doi: 10.1145/3639816.

[9] S. Duhan, P. Gulia, N. S. Gill, and E. Narwal, “RTR_Lite_MobileNetV2: A lightweight and efficient model for plant disease detection and classification,” Curr. Plant Biol., vol. 42, no. june, p. 100459, Jun. 2025, doi: 10.1016/j.cpb.2025.100459.

[10] H. Bouakkaz, M. Bouakkaz, C. A. Kerrache, and S. Dhelim, “Enhanced classification of medicinal plants using deep learning and optimized CNN architectures,” Heliyon, vol. 11, no. 3, p. e42385, Feb. 2025, doi: 10.1016/j.heliyon.2025.e42385.

[11] J. Sharma et al., “Deep learning based ensemble model for accurate tomato leaf disease classification by leveraging ResNet50 and MobileNetV2 architectures,” Sci. Rep., vol. 15, no. 1, p. 13904, Apr. 2025, doi: 10.1038/s41598-025-98015-x.

[12] U. V. Nnamdi and V. Abolghasemi, “Optimised MobileNet for very lightweight and accurate plant leaf disease detection,” Sci. Rep., vol. 15, no. 1, p. 43690, Dec. 2025, doi: 10.1038/s41598-025-27393-z.

[13] G. Sangar and V. Rajasekar, “Optimized classification of potato leaf disease using EfficientNet-LITE and KE-SVM in diverse environments,” Front. Plant Sci., vol. 16, p. 1499909, May 2025, doi: 10.3389/fpls.2025.1499909.

[14] S. Hajar, M. Murinto, and A. Yudhana, “Comparison of Transfer Learning Strategies Using MobileNetV2 and ResNet50 for Ecoprint Leaf Classification,” J. Tek. Inform., vol. 6, no. 5, pp. 3251–3264, Oct. 2025, doi: 10.52436/1.jutif.2025.6.5.5266.

[15] M. Asghar et al., “A lightweight hybrid model for scalable and robust plant leaf disease classification,” Sci. Rep., vol. 15, no. 1, p. 32353, Sep. 2025, doi: 10.1038/s41598-025-08788-4.

[16] M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” in 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, Jun. 2018, pp. 4510–4520. doi: 10.1109/CVPR.2018.00474.

[17] K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Jun. 2016, pp. 770–778. doi: 10.1109/CVPR.2016.90.

[18] O. Russakovsky et al., “ImageNet Large Scale Visual Recognition Challenge,” Int. J. Comput. Vis., vol. 115, no. 3, pp. 211–252, Dec. 2015, doi: 10.1007/s11263-015-0816-y.

[19] S. J. Pan and Q. Yang, “A Survey on Transfer Learning,” IEEE Trans. Knowl. Data Eng., vol. 22, no. 10, pp. 1345–1359, Oct. 2010, doi: 10.1109/TKDE.2009.191.

[20] D. P. Kingma and J. L. Ba, “Adam: A Method for Stochastic Optimization,” in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, International Conference on Learning Representations, ICLR, Dec. 2014, p. 15. doi: 10.48550/arXiv.1412.6980.

[21] E. A. Aldakheel, M. Zakariah, and A. H. Alabdalall, “Detection and identification of plant leaf diseases using YOLOv4,” Front. Plant Sci., vol. 15, p. 1355941, Apr. 2024, doi: 10.3389/fpls.2024.1355941.

[22] E. Van de Velde, K. Steppe, and M.-C. Van Labeke, “Leaf morphology, optical characteristics and phytochemical traits of butterhead lettuce affected by increasing the far-red photon flux,” Front. Plant Sci., vol. 14, p. 1129335, Aug. 2023, doi: 10.3389/fpls.2023.1129335.

[23] E. Purwanti, N. Mahmudati, S. F. Faradila, and A. Fauzi, “Utilization of plants as traditional medicine for various diseases: Ethnobotany study in Sumenep, Indonesia,” in AIP Conference Proceedings, American Institute of Physics Inc., Apr. 2020, p. 040024. doi: 10.1063/5.0002430.

[24] T. Ekar and S. Kreft, “Common risks of adulterated and mislabeled herbal preparations,” Food Chem. Toxicol., vol. 123, no. Januar, pp. 288–297, Jan. 2019, doi: 10.1016/j.fct.2018.10.043.

[25] D. Munjal, L. Singh, M. Pandey, and S. Lakra, “A Systematic Review on the Detection and Classification of Plant Diseases Using Machine Learning,” Int. J. Softw. Innov., vol. 11, no. 1, pp. 1–25, Dec. 2022, doi: 10.4018/IJSI.315657.

[26] Y. Kurmi and S. Gangwar, “A leaf image localization based algorithm for different crops disease classification,” Inf. Process. Agric., vol. 9, no. 3, pp. 456–474, Sep. 2022, doi: 10.1016/j.inpa.2021.03.001.

[27] M. V. Shewale and R. D. Daruwala, “High performance deep learning architecture for early detection and classification of plant leaf disease,” J. Agric. Food Res., vol. 14, no. December, p. 100675, Dec. 2023, doi: 10.1016/j.jafr.2023.100675.

[28] D. Sutaji and O. Yıldız, “LEMOXINET: Lite ensemble MobileNetV2 and Xception models to predict plant disease,” Ecol. Inform., vol. 70, no. September, p. 101698, Sep. 2022, doi: 10.1016/j.ecoinf.2022.101698.

[29] R. Leelavathi and M. Kalamani, “Medicinal plant leaf disease classification using optimal weighted features with dilated adaptive DenseNet and attention mechanism,” Sci. Rep., vol. 15, no. 1, p. 36852, Oct. 2025, doi: 10.1038/s41598-025-20629-y.

[30] M. Flórez et al., “Deep Learning Application for Biodiversity Conservation and Educational Tourism in Natural Reserves,” ISPRS Int. J. Geo-Information, vol. 13, no. 10, p. 358, Oct. 2024, doi: 10.3390/ijgi13100358.

[31] M. S. Ikrar Musyaffa, N. Yudistira, M. A. Rahman, A. H. Basori, A. B. Firdausiah Mansur, and J. Batoro, “IndoHerb: Indonesia medicinal plants recognition using transfer learning and deep learning,” Heliyon, vol. 10, no. 23, p. e40606, Dec. 2024, doi: 10.1016/j.heliyon.2024.e40606.

[32] Yuda Apriansyah, N. Khairi, Haikal Habibi Siregar, Supiyandi, and Aidil Halim Lubis, “Implementation of Edge Detection Using the Sobel Operator on Papaya Leaf Images,” J. Ilm. Inform. dan Komput., vol. 2, no. 2, pp. 164–168, Dec. 2025, doi: 10.69533/ma9w7b36.

[33] D. Chetia, S. K. Kalita, P. P. P. Baruah, D. Dutta, and T. Akhter, “Identification of Traditional Medicinal Plant Leaves Using an Effective Deep Learning Model and Self-Curated Dataset,” in Communications in Computer and Information Science, vol. 2335 CCIS, Springer Science and Business Media Deutschland GmbH, 2025, pp. 342–356. doi: 10.1007/978-3-031-83793-7_22.

[34] M. Xu, S. Yoon, Y. Jeong, and D. S. Park, “Transfer learning for versatile plant disease recognition with limited data,” Front. Plant Sci., vol. 13, p. 1010981, Nov. 2022, doi: 10.3389/fpls.2022.1010981.

[35] K. L. D. Viet, K. Le Ha, T. N. Quoc, and V. T. Hoang, “Medicinal Plants Identification Using Federated Deep Learning,” Procedia Comput. Sci., vol. 234, pp. 247–254, Jan. 2024, doi: 10.1016/j.procs.2024.02.171.

[36] O. A. Malik, N. Ismail, B. R. Hussein, and U. Yahya, “Automated Real-Time Identification of Medicinal Plants Species in Natural Environment Using Deep Learning Models—A Case Study from Borneo Region,” Plants, vol. 11, no. 15, p. 1952, Jul. 2022, doi: 10.3390/plants11151952.

[37] S. Sachar and A. Kumar, “Deep ensemble learning for automatic medicinal leaf identification,” Int. J. Inf. Technol., vol. 14, no. 6, pp. 3089–3097, Oct. 2022, doi: 10.1007/s41870-022-01055-z.

[38] Ragil Gigih Utomo and Rodhiyah Mardhiyyah, “Enhancing Convolutional Neural Network Accuracy for Herbal Leaf Classification Using Squeeze and Excitation Attention,” J. Sci. Res. Educ. Technol., vol. 4, no. 4, pp. 2354–2369, 2025, Accessed: May 28, 2026, doi: 10.58526/jsret.v4i4.938.

[39] M. F. Nazuli, M. Fachrurrozi, M. Q. Rizqie, A. Abdiansah, and M. Ikhsan, “A Image Classification of Poisonous Plants Using the MobileNetV2 Convolutional Neural Network Model Method,” MATRIK J. Manajemen, Tek. Inform. dan Rekayasa Komput., vol. 24, no. 2, pp. 371–380, Mar. 2025, doi: 10.30812/matrik.v24i2.4284.

[40] P. K. Sethy, N. K. Barpanda, A. K. Rath, and S. K. Behera, “Deep feature based rice leaf disease identification using support vector machine,” Comput. Electron. Agric., vol. 175, no. August, p. 105527, Aug. 2020, doi: 10.1016/j.compag.2020.105527.

[41] R. K. Mishra, G. Y. S. Reddy, and H. Pathak, “The Understanding of Deep Learning: A Comprehensive Review,” Math. Probl. Eng., vol. 2021, no. 1, pp. 1–15, Apr. 2021, doi: 10.1155/2021/5548884.

[42] G. Dhingra, V. Kumar, and H. D. Joshi, “Study of digital image processing techniques for leaf disease detection and classification,” Multimed. Tools Appl., vol. 77, no. 15, pp. 19951–20000, Aug. 2018, doi: 10.1007/s11042-017-5445-8.

[43] M. Meiriyama, S. Devella, and S. M. Adelfi, “Klasifikasi Daun Herbal Berdasarkan Fitur Bentuk dan Tekstur Menggunakan KNN,” JATISI (Jurnal Tek. Inform. dan Sist. Informasi), vol. 9, no. 3, pp. 2573–2584, Sep. 2022, doi: 10.35957/jatisi.v9i3.2974.

[44] Desak Made Sidantya Amanda Putri, G K Gandhiadi, and I GN Lanang Wijayakusuma, “Perbandingan Metode Transfer Learning untuk Identifikasi Tumbuhan Herbal Berbasis Lontar Usada Taru Pramana,” JST (Jurnal Sains dan Teknol., vol. 14, no. 1, pp. 77–89, May 2025, doi: 10.23887/jstundiksha.v14i1.92414.

[45] A. Kasim, M. Bakri, and A. Septiarini, “The Artificial Neural Networks (ANN) for Batik Detection Based on Textural Features,” in Proceedings of the Proceedings of the 7th Mathematics, Science, and Computer Science Education International Seminar, MSCEIS 2019, 12 October 2019, Bandung, West Java, Indonesia, EAI, Jul. 2020, p. 9. doi: 10.4108/eai.12-10-2019.2296538.

[46] M. K. Muhammad Akbar, S.Kom. et al., The Next Frontier of AI: Unveiling the Hidden Potentials: “Masa Depan AI: Mengungkap Potensi yang Tersembunyi” - Bertuah Press. Accessed: May 28, 2026. [Online]. Available: https://bertuahpress.com/the-next-frontier-of-ai-unveiling-the-hidden-potentials-masa-depan-ai-mengungkap-potensi-yang-tersembunyi/.

[47] J. Heaton, “Ian Goodfellow, Yoshua Bengio, and Aaron Courville: Deep learning,” Genet. Program. Evolvable Mach., vol. 19, no. 1–2, pp. 305–307, Jun. 2018, doi: 10.1007/s10710-017-9314-z.

[48] C. Shorten and T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,” J. Big Data, vol. 6, no. 1, p. 60, Dec. 2019, doi: 10.1186/s40537-019-0197-0.

[49] L. Perez and J. Wang, “The Effectiveness of Data Augmentation in Image Classification using Deep Learning,” in Computer Vision and Pattern Recognition (cs.CV, Dec. 2017, p. 8. doi: 10.48550/arXiv.1712.04621.

[50] Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, May 2015, doi: 10.1038/nature14539.

[51] A. Saxena, “An Introduction to Convolutional Neural Networks,” Int. J. Res. Appl. Sci. Eng. Technol., vol. 10, no. 12, pp. 943–947, Dec. 2022, doi: 10.22214/ijraset.2022.47789.




Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571  (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
 andri.pranolo.id@ieee.org (publication issues)

View IJAIN Stats

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0