Skip to content
Microsystems, Electronics and Acoustics
ISSN 2523-4447 · e‑ISSN 2523-4455 Open Access · CC BY-SA 4.0
Vol. 28 · Issue 2 · 2023 May 19, 2023 Electronic Systems and Signals

Research of the Characteristics of a Convolutional Neural Network on the ESP32-CAM Microcontroller

RS
Rostyslav Dmytrovych Sharuiev Corresponding Національний технічний університет України «Київський політехнічний інститут імені Ігоря Сікорського» Ukraine
PP
Pavlo Vasylovych Popovych Національний технічний університет України «Київський політехнічний інститут імені Ігоря Сікорського» Ukraine
Pages277487.1-277487.7 PublishedMay 19, 2023
VOL 28 · ISS 2 · 2023 To the 125th Anniversary of Igor Sikorsky Kyiv Polytechnic Institute View issue

Abstract

The paper is devoted to solving the problem of using neural networks for real-time image recognition on low-power portable devices running on microcontrollers. The ESP-32 © CAM microcontroller was used as the target device, on which an artificial neural network was deployed, written using the Python ® programming language and the Tensorflow © library for building neural networks. The performance of the microcontroller and personal computer for object detection using a neural network and their classification were compared in the paper. The image recognition time and percentage of correctly classified objects were compared. The paper shows that the number of training epochs affects the accuracy of object classification in the image. The obtained results show that increasing the number of training epochs increases the accuracy of object recognition using the studied neural network, but a significant increase in the number of epochs does not lead to a significant improvement in recognition accuracy. The difference in the obtained results for the microcontroller and personal computer image recognition accuracy ranges from 5%.

Keywords

References

  1. European Parliament, "What is artificial intelligence and how is it used?," European Parliament news, 04 09 2020. [Online]. Available: https://www.europarl.europa.eu/news/en/headlines/society/20200827STO85804/what-is-artificial-intelligence-and-how-is-it-used . [Accessed 01 05 2023].
  2. DATACONOMY MEDIA GMBH, "AI’s invisible hand on daily life," Eray Eliaçık, 09 05 2022. [Online]. Available: https://dataconomy.com/2022/05/09/artificial-intelligence-in-everyday-life/ . [Accessed 01 05 2023]
  3. J. Gerhart, Home Automation & Wiring, New York: McGraw-Hill, 1999. ISBN: 978-0070246744
  4. Startup info, "Most Common Problems with Smart Home Technology Systems," Kossi Adzo, 09 08 2022. [Online]. Available: https://startup.info/most-common-problems-with-smart-home-technology-systems/ . [Accessed 01 05 2023]
  5. R. O. Duda, P. E. Hart and D. G. Stork, Pattern Classification, Toronto: A Wiley Interscience publication John Wiley & Sons, 1973. ISBN: 978-0-471-05669-0
  6. Termin.in.ua, "Neural network — what it is, how it works and why it is needed.," [Online]. Available: https://termin.in.ua/neyromerezha/#lwptoc21 . [Accessed 03 05 2023]
  7. The Motley Fool., "3 Things You Need to Know About Apple's A12 Bionic Chip," Ashraf Eassa , 14 09 2018. [Online]. Available: https://www.fool.com/investing/2018/09/14/3-things-you-need-to-know-about-apples-a12-bionic.aspx . [Accessed 03 05 2023]
  8. K. Amer, M. Samy, M. Shaker and M. ElHelw, "Deep Convolutional Neural Network-Based Autonomous Drone Navigation," [Online]. Available: https://arxiv.org/ftp/arxiv/papers/1905/1905.01657.pdf . [Accessed 17 05 2023]
  9. P. Warden and D. Situnayake, TinyML: Machine Learning with TensorFlow Lite on Arduino and Ultra-Low-Power Microcontrollers, O'Reilly Media, 2019. ISBN: 978-1492052043
  10. Python organization, "Python official webpage," Python.org, [Online]. Available: https://www.python.org/ . [Accessed 13 04 2023]
  11. Tensorflow organization, "Tensorflow official webpage," Google incorporated, [Online]. Available: https://www.tensorflow.org/?hl=ru . [Accessed 13 04 2023]
  12. X. Jiang, A. Hadidp, Y. Pang, E. Granger and X. Feng, Deep Learning in Object Detection and Recognition, Texas: Computer Science and Engineering Department, University of Texas at Arlington, 2019. ISBN: 978-9811506512
  13. U. Kern, "Convolutional neural network (CNN)," [Online]. Available: https://ujjwalkarn.me/2016/08/11/intuitive-explanation-convnets/ . [Accessed 17 04 2023]
  14. M. Minsky and S. Papert, Perceptrons. An Introduction to Computational Geometry, Massachusetts: The MIT Press, 1969. ISBN: 9780262630221
  15. Zhytomyr State Technical University, "Explanation of the principle of convolution in neural networks," [Online]. Available: https://conf.ztu.edu.ua/wp-content/uploads/2019/02/45-1.pdf . [Accessed 19 04 2023]
  16. Tensorflow organization, "Cifar10 dataset," Google incorporated, [Online]. Available: https://www.tensorflow.org/datasets/catalog/cifar10?hl=ru . [Accessed 13 04 2023]
  17. A. Krizhevsky, V. Nair and G. Hinton, "Explanation of the CIFAR-10 dataset," [Online]. Available: https://www.cs.toronto.edu/~kriz/cifar.html . [Accessed 19 04 2023]
  18. Lenovo corporation, "Lenovo Legion," Lenovo corporation, [Online]. Available: https://www.lenovo.com/ua/uk/laptops/legion-laptops/legion-5-series/Legion-5-15ACH6H/p/88GMY501582 . [Accessed 13 04 2023]
  19. AI-Thinker, "ESP-32 CAM datasheet," [Online]. Available: https://docs.ai-thinker.com/_media/esp32/docs/esp32-cam_product_specification_zh.pdf . [Accessed 14 02 2023]
  20. Micropython organization , "Micro Python," [Online]. Available: https://micropython.org/download/esp32/ . [Accessed 20 02 2023]
  21. Omnivision, "OV2640 2Mp/FOV120-NV datasheet," [Online]. Available: https://www.ovt.com/wp-content/uploads/2021/01/OV2640-Volume-Production-FINAL.pdf . [Accessed 20 02 2023]
  22. Tensorflow organization, "Tensorflow lite compiler," Google incorporated, [Online]. Available: https://www.tensorflow.org/lite?hl=en . [Accessed 28 04 2022]
  23. V. Chandra and A. Hareendran, Artificial Intelligence and Machine Learning, Delhi: PHI Learning, 2014
  24. Evergreen, "What are convolutional neural networks and where are they applied?," [Online]. Available: https://evergreens.com.ua/ua/articles/cnn.html . [Accessed 17 04 2023]
  25. 130.com.ua, "What is an onboard computer and why is it necessary?," [Online]. Available: https://130.com.ua/uk/what-is-trip-computers/ . [Accessed 11 04 2023]
  26. A. H. Habibi and H. E. Jahani, Guide to Convolutional Neural Networks, Spain: Springer International Publishing, 2017. ISBN: 978-3319575490
§ 06 — Related

Similar articles in this journal

Related peer-reviewed studies published in this journal.
View all issues

Quasistatic Identification of The Shading Structure of Solar Panels by The Method of Cardinal Number Vectors

PhD, Assoc. Prof. Olena Olehivna Abakumova, Dr.Sc.(Eng.), Prof. Valerii Yakovych Zhuikov, Mykola O. Lukianov

In the article the problem of identification the shading structure of solar panels is considered. The relevance of the study is conditioned by the necessity of rapid and…

#solar panels #photovoltaic surface #shadow structure modeling #quasistatic identification
p. 362283.1-362283.7
10.20535/2523-4455.mea.362283

A A Complex Method for Non-invasive Fetal Electrocardiogram Signal Extraction and Cardiac Arrhythmia Classification

Dmytro A. Shevchuk, PhD, Assoc. Prof. Nataliia Heorhiivna Ivanushkina

This study is devoted to the development of a complex method for extracting the fetal electrocardiogram (fECG) from non-invasive abdominal recordings and for the…

#abdominal electrocardiogram #fetal electrocardiogram #arrhythmia #blind source separation
p. 356487.1-356487.11
10.20535/2523-4455.mea.356487

Simulation Modeling of a Filter-Compensating Converter for a Three-Phase Three-Wire Network

Ivan Andriiovych Vakulenko, PhD, Assoc. Prof. Dmytro Anatoliiovych Mykolaiets, PhD, Assoc. Prof. Kateryna Serhiivna Klen

This paper addresses the critical issue of power quality degradation in modern power systems caused by the proliferation of non-linear loads. The study focuses on the…

#filter-compensating converter #three-phase three-wire network #power quality #total harmonic distortion
p. 361138.1-361138.6
10.20535/2523-4455.mea.361138

Similar Articles

1-10 of 34

You may also start an advanced similarity search for this article.