Detection and Tracking of Firearms and Cold Weapons Using Deep Learning Networks

Document Type : -

Authors

1 Master student of artificial intelligence and robotics, Malek Ashtar University of Technology

2 Malek Ashtar University of Technology

Abstract

Providing and increasing security in special and public places has always been the focus of everyone in various fields. Many measures such as installing surveillance cameras and placing officers on the spot have been taken to provide and increase the security in public places such as schools, universities, offices, and so on. Because these cameras detect suspicious activity by human operators, factors such as distraction, lack of awareness, fatigue, and a variety of other factors can affect the quality of surveillance; however, the firearms detection system detects and identifies defined weapons automatically. They can send special messages to military and security officials in a timely manner. In this paper, the Yolo version 5 algorithm is used to detect and track firearms (pistols) and cold weapons (knives), and the Deepsort algorithm is used for tracking. The article investigates the system's performance. Finally, after training with a special data set of firearms and cold steel, the proposed system performs firearms and cold steel detection operations with 99.50 percent accuracy. Furthermore, the proposed system has provided adequate accuracy in terms of scale, rotation, and obstruction.

Keywords

Main Subjects


Smiley face

  1. Tiwari, R. K.; Verma, G. K. “A Computer Vision based Framework For Visual Gun Detection Using Harris Interest Point Detector”; Procedia Computer Science, 2015.
  2. Lim, J.; Al Jobayer, M. I.; Baskaran, V. M.; Lim, J. M.; See, J.; Wong, K. “Deep Multi-level Feature Pyramids: Application For Non-canonical Firearm Detection in Video Surveillance”; Engineering Applications of Artificial Intelligence, 2021.
  3. Mehta, P.; Kumar, A.; Bhattacharjee, S. “Fire and Gun Violence Based Anomaly Detection System Using Deep Neural Networks”; International Conference on Electronics and Sustainable Communication Systems, 2020,199–204.
  4. Warsi, A.; Abdullah, M.; Husen, M. N.; Yahya, M.; Khan, S.; Jawaid, N. “Gun Detection System Using YOLOv3”; IEEE Int. Conf. Smart Instrumentation, Measurement and Application, 2019.
  5. Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A. “You Only Look Once: Unified, Real-time Object Detection”; Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2016.
  6. Girshick, R.; Donahue, J.; Darrell, T.; Malik, J. “Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation”; Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2014, 580-587.
  7. Deng, J.; Dong, W.; Socher, R.; Li, L.-J.; Li, K.; Fei-Fei, L. “Imagenet: A Large-Scale Hierarchical Image Database”; IEEE Conf. Computer Vision and Pattern Recognition, 2009.
  8. Egiazarov, A.; Mavroeidis, V.; Zennaro, F. M.; Vishi, K. “Firearm Detection and Segmentation Using an Ensemble of Semantic Neural Networks”; European Intelligence and Security Informatics Conference, 2019.
  9. Wu, J. “Introduction to Convolutional Neural Networks”; National Key Lab for Novel Software Technology. Nanjing University. China, 2017.
  10. Agarwal, N.; Sondhi, A.; Chopra, K.; Singh,G. “Transfer Learning: Survey and Classification”; Smart Innovations in Communication and Computational Sciences, Springer, 2021.
  11. Yilmaz, A.; Javed, O.; Shah, M. “Object Tracking: A Survey”; ACM Computing Surveys 2006, 38, 13.
  12. Veeramani, B.; Raymond, J. W.; Chanda, P. “DeepSort: Deep Convolutional Networks for Sorting Haploid Maize Seeds”; BMC bioinformatics, 2018.
  13. Bochkovskiy, A.; Wang, C.-Y.; Liao, H.-Y. Mark Liao “Yolov4: Optimal Speed and Accuracy of Object Detection”; arXiv
  14. Russakovsky, O. “Imagenet Large Scale Visual Recognition Challenge”; Int. J. Computer Vision 2004, 10934.
  15. Huang, G.; Liu, Z.; Van Der Maaten, L.; Weinberger, K. Q. “Densely Connected Convolutional Networks”; Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2017.
  16. He, K.; Zhang, X.; Ren, S.; Sun, J. “Deep Residual Learning for Image Recognition”; Proc. IEEE conf. Computer Vision and Pattern Recognition, 2016.
  17. Lin, T.-Y. “Microsoft Coco: Common Objects in Context”; European Conf. Computer Vision, 2014.
  18. Li, X. “Weighted Feature Pyramid Networks for Object Detection”; IEEE Int. Conf. Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking, 2019.
  19. Liu, S.; Qi, L.; Qin, H.; Shi, J.; Jia, J. “Path Aggregation Network for Instance Segmentation”; Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2018.
  20. Tan, M.; Pang, R.; Le, Q. V. “Efficientdet: Scalable and Efficient Object Detection”; Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, 2020.
  21. Vanholder, H. “Efficient Inference with Tensorrt”; GPU Technology Conference, 2016.
  22. Tohidifar, A.; Dadashtabar Ahmadi, K.; Kiyaee Khosh Rudbari A. K. “Detection of Lumbar Guns in Surveillance Cameras in Difficult Situations, Including Occlusion, Different Angles and Long Distances Using Deep Learning”; Information and Communication Technology in Policing 1400, 2, 9-21 (In Persian)
  23. https://developer.nvidia.com/tensorrt
  • Receive Date: 08 June 2022
  • Revise Date: 02 December 2022
  • Accept Date: 16 January 2023
  • Publish Date: 20 February 2023