Smart City Surveillance: Edge Technology Face Recognition Robot Deep Learning Based

Document Type : Original Article

Authors

Faculty of Exact Science, Department of Computer Science, University of Mustapha Stambouli, Mascara, Algeria

Abstract

In the contemporary context, the imperative to strengthen security and safety measures has become increasingly evident. Given the rapid pace of technological advancement, the development of intelligent and efficient surveillance solutions has garnered significant interest, particularly within the realm of smart city (SC). Surveillance systems have been transformed with the emergence of edge technology (ET), the Internet of Things (IoT), and deep learning (DL) to become key components of SC, notably the domain of face recognition (FR). This work introduces a smart surveillance car robot based on the ESP32-CAM micro-controller, coupled with a FR model that combines DL models and traditional algorithms. The Haar-Cascade (HC) algorithm is employed for face detection, while feature extraction relies on a proposed convolutional neural network (CNN) and predifined DL models, VGG and ResNet. While the classification is made by two distinct algorithms: Naive Bayes (NB) and K-nearest neighbors (KNN). Validation experiments demonstrate the superiority of a composite model comprising HC, VGG, and KNN, achieving accuracy rates of 92.00%, 94.00%, and 96.00% on the LFW, AR, and ORL databases, respectively. Additionally, the surveillance car robot exhibits real-time responsiveness, including email alert notifications, and boasts an exceptional recognition accuracy rate of 99.00% on a custom database. This ET surveillance solution offers advantages of energy efficiency, portability, remote accessibility, and economic affordability.

Graphical Abstract

Smart City Surveillance: Edge Technology Face Recognition Robot Deep Learning Based

Keywords

Main Subjects

References

  1. Bellavista P, Chatzimisios P, Foschini L, Paradisioti M, Scotece D, editors. A support infrastructure for machine learning at the edge in smart city surveillance. 2019 IEEE Symposium on Computers and Communications (ISCC); 2019: IEEE. 10.1109/iscc47284.2019.8969779
  2. Ezzat MA, Abd El Ghany MA, Almotairi S, Salem MA-M. Horizontal review on video surveillance for smart cities: Edge devices, applications, datasets, and future trends. Sensors. 2021;21(9):3222. 10.3390/s21093222
  3. Nauman A, Qadri YA, Amjad M, Zikria YB, Afzal MK, Kim SW. Multimedia Internet of Things: A comprehensive survey. Ieee Access. 2020;8:8202-50. 10.1109/access.2020.2964280
  4. Jiménez-Bravo DM, Lozano Murciego Á, Sales A, Augusto Silva L, De La Iglesia DH. Edge Face Recognition System Based on One-Shot Augmented Learning. 2022. 10.9781/ijimai.2022.09.001
  5. Shi W, Pallis G, Xu Z. Edge computing [scanning the issue]. Proceedings of the IEEE. 2019;107(8):1474-81.
  6. Silva BN, Khan M, Han K. Towards sustainable smart cities: A review of trends, architectures, components, and open challenges in smart cities. Sustainable cities and society. 2018;38:697-713. 10.1016/j.scs.2018.01.053
  7. Lai CS, Jia Y, Dong Z, Wang D, Tao Y, Lai QH, et al. A review of technical standards for smart cities. Clean Technologies. 2020;2(3):290-310. 10.3390/cleantechnol2030019
  8. Al‐Turjman F, Zahmatkesh H, Shahroze R. An overview of security and privacy in smart cities' IoT communications. Transactions on Emerging Telecommunications Technologies. 2022;33(3):e3677. 10.1002/ett.3677
  9. Singh SK, Azzaoui A, Kim TW, Pan Y, Park JH. DeepBlockScheme: A deep learning-based blockchain driven scheme for secure smart city. Human-centric Computing and Information Sciences. 2021;11(12):1-13. 10.22967/HCIS.2021.11.012
  10. Khan PW, Byun Y-C, Park N. A data verification system for CCTV surveillance cameras using blockchain technology in smart cities. Electronics. 2020;9(3):484. 10.3390/electronics9030484
  11. Kortli Y, Jridi M, Al Falou A, Atri M. Face recognition systems: A survey. Sensors. 2020;20(2):342. 10.3390/s20020342
  12. Masud M, Muhammad G, Alhumyani H, Alshamrani SS, Cheikhrouhou O, Ibrahim S, et al. Deep learning-based intelligent face recognition in IoT-cloud environment. Computer Communications. 2020;152:215-22. 10.1016/j.comcom.2020.01.050
  13. Kumar M, Raju KS, Kumar D, Goyal N, Verma S, Singh A. An efficient framework using visual recognition for IoT based smart city surveillance. Multimedia Tools and Applications. 2021:1-19. 10.1007/s11042-020-10471-x
  14. Charoqdouz E, Hassanpour H. Feature extraction from several angular faces using a deep learning based fusion technique for face recognition. International Journal of Engineering, Transactions B: Applications. 2023;36(8):1548-55. 10.5829/ije.2023.36.08b.14
  15. Shahbakhsh MB, Hassanpour H. Empowering face recognition methods using a gan-based single image super-resolution network. International Journal of Engineering, Transactions A: Basics. 2022;35(10):1858-66. 10.5829/ije.2022.35.10a.05
  16. Faisal F, Hossain SA, editors. Smart security system using face recognition on raspberry Pi. 2019 13th International Conference on Software, Knowledge, Information Management and Applications (SKIMA); 2019: IEEE. 10.1109/skima47702.2019.8982466
  17. Adjabi I, Ouahabi A, Benzaoui A, Taleb-Ahmed A. Past, present, and future of face recognition: A review. Electronics. 2020;9(8):1188. 10.20944/preprints202007. 0479.v1
  18. Hassanpour H, Ghasemi M. A three-stage filtering approach for face recognition. International Journal of Engineering. 2021;34(8):1856-64. 10.5829/ije.2021.34.08b.061
  19. Kakarla S, Gangula P, Rahul MS, Singh CSC, Sarma TH, editors. Smart attendance management system based on face recognition using CNN. 2020 IEEE-HYDCON; 2020: IEEE. 10.1109/hydcon48903.2020.9242847
  20. Viola P, Jones MJ. Robust real-time face detection. International journal of computer vision. 2004;57:137-54. 10.1023/B:VISI.0000013087.49260.fb
  21. King DE. Dlib-ml: A machine learning toolkit. The Journal of Machine Learning Research. 2009;10:1755-8. 10.1145/1577069.1755843
  22. Schroff F, Kalenichenko D, Philbin J, editors. Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE conference on computer vision and pattern recognition; 2015. 10.48550/ARXIV.1503.03832
  23. Kaur P, Krishan K, Sharma SK, Kanchan T. Facial-recognition algorithms: A literature review. Medicine, Science and the Law. 2020;60(2):131-9. 10.1177/0025802419893168
  24. Baltrusaitis T, Zadeh A, Lim YC, Morency L-P, editors. Openface 2.0: Facial behavior analysis toolkit. 2018 13th IEEE international conference on automatic face & gesture recognition (FG 2018); 2018: IEEE. 10.1109/fg.2018.00019
  25. Firouzi M, Fadaei S, Rashno A. A new framework for canny edge detector in hexagonal lattice. International Journal of Engineering. 2022;35(8):1588-98. 10.5829/ije.2022.35.08b.15
  26. Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556. 2014. 10.48550/ARXIV.1409.1556
  27. Developers T. TensorFlow (Zenodo, 2021). DOI.
  28. Liu J. Convolutional neural network-based human movement recognition algorithm in sports analysis. Frontiers in psychology. 2021;12:663359. 10.3389/fpsyg.2021.663359
  29. Tieleman T, Hinton G. Divide the gradient by a running average of its recent magnitude. coursera: Neural networks for machine learning. Technical report. 2017. https://www.cs.toronto.edu/~tijmen/csc321/slides/lecture_slides_lec6.pdf
International Journal of Engineering
Volume 37, Issue 1
TRANSACTIONS A: Basics
January 2024
Pages 25-36

Files

Cited by

Share

How to cite

Statistics