Skip to content
Microsystems, Electronics and Acoustics
ISSN 2523-4447 · e‑ISSN 2523-4455 Open Access · CC BY-SA 4.0
Vol. 27 · Issue 2 · 2022 Aug 25, 2022 Electronic Systems and Signals

The Method of Transformation of Image Classification Labels into Segmentation Masks

ВС
Володимир Сергійович Сидорський Corresponding Respeecher Ukraine
Pages262933-1-262933-9 PublishedAug 25, 2022
PDF (Ukrainian)
VOL 27 · ISS 2 · 2022 View issue

Abstract

Semantic image segmentation plays a crucial role in a wide range of industrial applications and has been receiving significant attention. Unfortunately, image segmentation tasks are notoriously difficult and different industries often require human experts. Convolutional neural networks (CNNs) have been successfully applied in many fields of image segmentation. But all of them still require a huge amount of hand-labeled data for training. A lot of research was conducted in the field of unsupervised and semi-supervised learning, which studies how to shrink the amount of training data at the same time preserving the quality of the model. But still another field of research - transformation of “cheap” (in terms of time, money and human resources) markup into “expensive” is novel. In this work a new approach of generating semantic segmentation masks, using only classification labels of the image, was proposed. Proposed method is based on the GradCam algorithm, which can produce image activation heatmap, using only class label. But GradCams’ heatmaps are raw for final use, so additional techniques and transforms should be applied in order to get final usable masks. Experiments were conducted on the task of detecting defects on steel plates — Kaggle- Severstal: Steel Defect Detection. After that Dice metric was computed using a classical training approach and proposed method: classical approach - 0.621, proposed method - 0.465. Proposed approach requires much less human resources compared to the classical approach. Moreover, after visual inspection of results it is obvious that the proposed approach has successfully completed the task of defect localization.

Keywords

#segmentation #neural networks #semi-supervised

References

  1. C. Gh. Amza, G. Amza, and D. Popescu, “Image Segmentation for Industrial Quality Inspection,” Fiabilitate şi Durabilitate, no. 01.Supliment, pp. 126–132, 2012, URL: https://www.utgjiu.ro/rev_mec/mecanica/pdf/2012-01.Supliment/21_Catalin%20Amza,%20Gheorghe%20Amza,%20Diana%20Popescu.pdf .
  2. R. Azad, N. Khosravi, M. Dehghanmanshadi, J. Cohen-Adad, and D. Merhof, “Medical Image Segmentation on MRI Images with Missing Modalities: A Review,” Mar. 2022, DOI: https://doi.org/10.48550/arxiv.2203.06217
  3. K. Prakash, P. Saravanamoorthi, R. Sathishkumar, and M. Parimala, “A Study of Image Processing in Agriculture,” International Journal of Advanced Networking and Applications - IJANA, vol. 9, no. 1, pp. 3311–3315, 2017, URL: https://www.ijana.in/v9-1.php# .
  4. W. Weng and X. Zhu, “U-Net: Convolutional Networks for Biomedical Image Segmentation,” IEEE Access, vol. 9, pp. 16591–16603, May 2015, DOI: https://doi.org/10.48550/arXiv.1505.04597 DOI: https://doi.org/10.1109/ACCESS.2021.3053408
  5. V. Iglovikov and A. Shvets, “TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation,” Jan. 2018, DOI: https://doi.org/10.48550/arxiv.1801.05746
  6. Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, “UNet++: A Nested U-Net Architecture for Medical Image Segmentation,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11045 LNCS, pp. 3–11, Jul. 2018, DOI: https://doi.org/10.48550/arxiv.1807.10165
  7. T.-Y. Lin, P. Dollár, R. Girshick, K. He, B. Hariharan, and S. Belongie, “Feature Pyramid Networks for Object Detection,” Dec. 2016, DOI: https://doi.org/10.48550/arxiv.1612.03144
  8. L. E. Aik, T. W. Hong, and A. K. Junoh, “A New Formula to Determine the Optimal Dataset Size for Training Neural Networks,” ARPN Journal of Engineering and Applied Sciences, vol. 14, no. 1, pp. 52–61, Jan. 2019, URL: http://www.arpnjournals.org/jeas/research_papers/rp_2019/jeas_0119_7525.pdf
  9. S. Dridi, Unsupervised Learning - A Systematic Literature Review. 2021, URL: https://www.researchgate.net/publication/357380639_Unsupervised_Learning_-_A_Systematic_Literature_Review
  10. K. S. Kalyan, A. Rajasekharan, and S. Sangeetha, “AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing,” Aug. 2021, DOI: https://doi.org/10.48550/arxiv.2108.05542
  11. E. Arazo, Di. Ortego, P. Albert, N. E. O’Connor, and K. McGuinness, “Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning,” Proceedings of the International Joint Conference on Neural Networks, Aug. 2019, DOI: https://doi.org/10.48550/arxiv.1908.02983 DOI: https://doi.org/10.1109/IJCNN48605.2020.9207304
  12. Y. Tay et al., “Are Pre-trained Convolutions Better than Pre-trained Transformers?,” ACL-IJCNLP 2021 - 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, Proceedings of the Conference, pp. 4349–4359, May 2021, DOI: https://doi.org/10.48550/arxiv.2105.03322
  13. R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization,” Int J Comput Vis, vol. 128, no. 2, pp. 336–359, Oct. 2016, DOI: https://doi.org/10.1007/s11263-019-01228-7
  14. K. Simonyan and A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, Sep. 2014, DOI: http://doi.org/10.48550/arxiv.1409.1556
  15. A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” in Advances in Neural Information Processing Systems, 2012, vol. 25, URL: https://proceedings.neurips.cc/paper/2012/hash/c399862d3b9d6b76c8436e924a68c45b-Abstract.html
  16. T. Pearce, A. Brintrup, and J. Zhu, “Understanding Softmax Confidence and Uncertainty,” Jun. 2021, DOI: https://doi.org/10.48550/arxiv.2106.04972
  17. YU. P. Zaychenko, Osnovy proektuvannya intelektualʹnykh system. Navch. posibnyk. [Fundamentals of designing intelligent systems. Education manual.]. Kyiv: Vydavnychyy dim «Slovo», 2004
  18. J. T. Springenberg, A. Dosovitskiy, T. Brox, and M. Riedmiller, “Striving for Simplicity: The All Convolutional Net,” 3rd International Conference on Learning Representations, ICLR 2015 - Workshop Track Proceedings, Dec. 2014, DOI: https://doi.org/10.48550/arxiv.1412.6806
  19. “Severstal: Steel Defect Detection | Kaggle.” [Online]. Available: https://www.kaggle.com/c/severstal-steel-defect-detection
  20. D. Berrar, “Cross-Validation,” in Encyclopedia of Bioinformatics and Computational Biology, Elsevier, 2019, pp. 542–545. DOI: https://doi.org/10.1016/B978-0-12-809633-8.20349-X
  21. K. Namdar, M. A. Haider, and F. Khalvati, “A Modified AUC for Training Convolutional Neural Networks: Taking Confidence into Account,” Front Artif Intell, vol. 4, Jun. 2020, DOI: https://doi.org/10.3389/frai.2021.582928
  22. A. Labach, H. Salehinejad, and S. Valaee, “Survey of Dropout Methods for Deep Neural Networks,” Apr. 2019, DOI: https://doi.org/10.48550/arxiv.1904.13310
  23. D. A. Clevert, T. Unterthiner, and S. Hochreiter, “Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs),” 4th International Conference on Learning Representations, ICLR 2016 - Conference Track Proceedings, Nov. 2015, DOI: https://doi.org/10.48550/arxiv.1511.07289
  24. D. P. Kingma and J. L. Ba, “Adam: A Method for Stochastic Optimization,” 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, Dec. 2014, DOI: https://doi.org/10.48550/arxiv.1412.6980
  25. K. Mukherjee, A. Khare, and A. Verma, “A Simple Dynamic Learning Rate Tuning Algorithm For Automated Training of DNNs,” Oct. 2019, DOI: https://doi.org/10.48550/arxiv.1910.11605
  26. M. Tan and Q. v. Le, “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,” 36th International Conference on Machine Learning, ICML 2019, vol. 2019-June, pp. 10691–10700, May 2019, DOI: https://doi.org/10.48550/arxiv.1905.11946
  27. S. Elfwing, E. Uchibe, and K. Doya, “Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning,” Neural Networks, vol. 107, pp. 3–11, Feb. 2017, PMID: 29395652. DOI: https://doi.org/10.1016/j.neunet.2017.12.012
  28. A. Chattopadhay, A. Sarkar, P. Howlader, and V. N. Balasubramanian, “Grad-CAM++: Generalized gradient-based visual explanations for deep convolutional networks,” Proceedings - 2018 IEEE Winter Conference on Applications of Computer Vision, WACV 2018, vol. 2018-January, pp. 839–847, May 2018, DOI: https://doi.org/10.1109/WACV.2018.00097
  29. P. Izmailov, D. Podoprikhin, T. Garipov, D. Vetrov, and A. G. Wilson, “Averaging Weights Leads to Wider Optima and Better Generalization,” 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018, vol. 2, pp. 876–885, Mar. 2018, DOI: https://doi.org/10.48550/arxiv.1803.05407
  30. D. Shanmugam, D. Blalock, G. Balakrishnan, and J. Guttag, “Better Aggregation in Test-Time Augmentation,” Proceedings of the IEEE International Conference on Computer Vision, pp. 1194–1203, Nov. 2020, DOI: https://doi.org/10.48550/arxiv.2011.11156 DOI: https://doi.org/10.1109/ICCV48922.2021.00125
§ 06 — Related

Similar articles in this journal

Related peer-reviewed studies published in this journal.
View all issues

Quasistatic Identification of The Shading Structure of Solar Panels by The Method of Cardinal Number Vectors

PhD, Assoc. Prof. Olena Olehivna Abakumova, Dr.Sc.(Eng.), Prof. Valerii Yakovych Zhuikov, Mykola O. Lukianov

In the article the problem of identification the shading structure of solar panels is considered. The relevance of the study is conditioned by the necessity of rapid and…

#solar panels #photovoltaic surface #shadow structure modeling #quasistatic identification
p. 362283.1-362283.7
10.20535/2523-4455.mea.362283

A A Complex Method for Non-invasive Fetal Electrocardiogram Signal Extraction and Cardiac Arrhythmia Classification

Dmytro A. Shevchuk, PhD, Assoc. Prof. Nataliia Heorhiivna Ivanushkina

This study is devoted to the development of a complex method for extracting the fetal electrocardiogram (fECG) from non-invasive abdominal recordings and for the…

#abdominal electrocardiogram #fetal electrocardiogram #arrhythmia #blind source separation
p. 356487.1-356487.11
10.20535/2523-4455.mea.356487

Simulation Modeling of a Filter-Compensating Converter for a Three-Phase Three-Wire Network

Ivan Andriiovych Vakulenko, PhD, Assoc. Prof. Dmytro Anatoliiovych Mykolaiets, PhD, Assoc. Prof. Kateryna Serhiivna Klen

This paper addresses the critical issue of power quality degradation in modern power systems caused by the proliferation of non-linear loads. The study focuses on the…

#filter-compensating converter #three-phase three-wire network #power quality #total harmonic distortion
p. 361138.1-361138.6
10.20535/2523-4455.mea.361138

Similar Articles

1-10 of 31

You may also start an advanced similarity search for this article.