Deteksi Aktivitas Merokok Menggunakan Mobile Vision Transformer dan Class Activation Mapping


Authors

  • Anjas Sarma Irmansyah Universitas Bina Insan, Lubuklinggau, Indonesia
  • Budi Santoso Universitas Bina Insan, Lubuk Linggau, Indonesia
  • Nelly Khairani Daulay Universitas Bina Insan, Lubuk Linggau, Indonesia

DOI:

https://doi.org/10.47065/bulletincsr.v6i5.1042

Keywords:

MobileViT; Grad-CAM; Smoking Detection; Computer Vision; Deep Learning

Abstract

Smoking is one of the leading causes of various chronic diseases, including cardiovascular disease, lung cancer, and respiratory disorders, and contributes significantly to the increasing global mortality rate. Monitoring smoking activities in public areas, particularly in smoke-free zones, remains a major challenge due to limited human resources, the extensive coverage area, and the complexity of smoking behavior, which is difficult to detect manually. This study proposes a computer vision-based smoking activity detection system using the Mobile Vision Transformer (MobileViT) architecture, a lightweight and efficient deep learning model capable of extracting local features while capturing global contextual information from images. To improve the interpretability of the classification results, the Gradient-weighted Class Activation Mapping (Grad-CAM) method is employed to visualize the image regions that most influence the model's predictions. The Cigarette Smoker Detection dataset from Kaggle is used for training and testing, with preprocessing steps including image normalization, data augmentation, image resizing, and an 80:20 split for training and validation/testing, respectively. The model performance is evaluated using accuracy, precision, recall, F1-score, confusion matrix, and Grad-CAM visualization. The experimental results demonstrate that MobileViT effectively classifies smoking and non-smoking images with high accuracy, while Grad-CAM enhances the transparency and interpretability of the model's predictions. Therefore, the proposed system has strong potential to support the automated, efficient, and accurate monitoring of smoke-free zones as part of broader public health improvement efforts.

Downloads

Download data is not yet available.

References

World Health Organization, “Tobacco,” 2023. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/tobacco

Kementerian Kesehatan Republik Indonesia, Laporan Hasil Riset Kesehatan Dasar (Riskesdas) 2023, Jakarta: Badan Litbangkes, 2023.

Nuriyadin, “Analisis Klasifikasi Gambar Deteksi Merokok dengan Metode CNN,” Jurnal Informatika Komputer, Universitas Pamulang, 2024. [Online]. Available: https://openjournal.unpam.ac.id/index.php/jikom/article/view/42253

A. Khan, S. Khan, B. Hassan, and Z. Zheng, “CNN-Based Smoker Classification and Detection in Smart City Application,” Sensors, vol. 22, no. 3, p. 892, 2022.

A. Dosovitskiy et al., “An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale,” arXiv preprint arXiv:2010.11929, 2020.

S. Mehta and M. Rastegari, “MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer,” arXiv preprint arXiv:2110.02178, 2021.

R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization,” in Proc. IEEE International Conference on Computer Vision (ICCV), 2017, pp. 618–626.

I. D. Apostolopoulos, I. Athanasoula, M. Tzani, and P. P. Groumpos, “An Explainable Deep Learning Framework for Detecting and Localising Smoke and Fire Incidents: Evaluation of Grad-CAM++ and LIME,” Fire, vol. 5, no. 4, p. 57, 2022.

K. O’Shea and R. Nash, “An Introduction to Convolutional Neural Networks,” arXiv:1511.08458, 2015.

R. Yamashita, M. Nishio, R. K. Do, and K. Togashi, “Convolutional neural networks: an overview and application in radiology,” Insights into Imaging, vol. 9, pp. 611–629, 2018.

Edge Impulse, “AI Explainability with Grad-CAM: Visualizing Neural Network Decisions,” 2024. [Online]. Available: https://edgeimpulse.com

X. Zhao et al., “Explainable AI Techniques for CNN-based Models in Image Classification,” Applied Sciences, vol. 14, no. 17, p. 7462, 2024.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” in Proc. IEEE CVPR, 2016.

M. Sandler et al., “MobileNetV2: Inverted Residuals and Linear Bottlenecks,” in Proc. IEEE CVPR, 2018.

A. Howard et al., “Searching for MobileNetV3,” in Proc. IEEE ICCV, 2019.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified, Real-Time Object Detection,” in Proc. IEEE CVPR, 2016.

J. Deng et al., “ImageNet: A Large-Scale Hierarchical Image Database,” in Proc. IEEE CVPR, 2009.

I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. MIT Press, 2016.

F. Chollet, “Xception: Deep Learning with Depthwise Separable Convolutions,” in Proc. IEEE CVPR, 2017.

D. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” arXiv:1412.6980, 2015.


Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Deteksi Aktivitas Merokok Menggunakan Mobile Vision Transformer dan Class Activation Mapping

Dimensions Badge

ARTICLE HISTORY

Published: 2026-08-31

Abstract View: 10 times
PDF Download: 6 times

How to Cite

Irmansyah, A. S., Santoso, B., & Daulay, N. K. (2026). Deteksi Aktivitas Merokok Menggunakan Mobile Vision Transformer dan Class Activation Mapping. Bulletin of Computer Science Research, 6(5), 2309-2315. https://doi.org/10.47065/bulletincsr.v6i5.1042

Issue

Section

Articles