×

A real-time Chinese traffic sign detection algorithm based on modified YOLOv2. (English) Zbl 1461.94027

Summary: Traffic sign detection is an important task in traffic sign recognition systems. Chinese traffic signs have their unique features compared with traffic signs of other countries. Convolutional neural networks (CNNs) have achieved a breakthrough in computer vision tasks and made great success in traffic sign classification. In this paper, we present a Chinese traffic sign detection algorithm based on a deep convolutional network. To achieve real-time Chinese traffic sign detection, we propose an end-to-end convolutional network inspired by YOLOv2. In view of the characteristics of traffic signs, we take the multiple \( 1\times 1\) convolutional layers in intermediate layers of the network and decrease the convolutional layers in top layers to reduce the computational complexity. For effectively detecting small traffic signs, we divide the input images into dense grids to obtain finer feature maps. Moreover, we expand the Chinese traffic sign dataset (CTSD) and improve the marker information, which is available online. All experimental results evaluated according to our expanded CTSD and German Traffic Sign Detection Benchmark (GTSDB) indicate that the proposed method is the faster and more robust. The fastest detection speed achieved was 0.017 s per image.

MSC:

94A08 Image processing (compression, reconstruction, etc.) in information and communication theory
94A13 Detection theory in information and communication theory
68T45 Machine vision and scene understanding
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Mogelmose, A.; Trivedi, M.M.; Moeslund, T.B.; Vision-based traffic sign detection and analysis for intelligent driver assistance systems: Perspectives and survey; IEEE Trans. Intell. Transp. Syst.: 2012; Volume 13 ,1484-1497.
[2] Zhang, J.M.; Huang, Q.Q.; Wu, H.L.; Liu, Y.K.; A shallow network with combined pooling for fast traffic sign recognition; Information: 2017; Volume 8 .
[3] Wu, Y.; Liu, Y.; Li, J.; Liu, H.; Hu, X.; Traffic sign detection based on convolutional neural networks; Proceedings of the International Joint Conference on Neural Networks: ; .
[4] Redmon, J.; Divvala, S.; Girshick, R.; Farhadi, A.; You only look once: Unified, real-Time object detection; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: ; ,779-788.
[5] Stallkamp, J.; Schlipsing, M.; Salmen, J.; Schlipsing, M.; The German traffic sign recognition benchmark: A multi-class classification competition; Proceedings of the IEEE International Joint Conference on Neural Networks: ; ,1453-1460.
[6] Yang, Y.; Luo, H.L.; Xu, H.R.; Wu, F.C.; Towards real-time traffic sign detection and classification; IEEE Trans. Intell. Transp. Syst.: 2016; Volume 17 ,2022-2031.
[7] Redmon, J.; Farhadi, A.; YOLO9000: Better, faster, stronger; arXiv: 2016; .
[8] Wang, G.Y.; Ren, G.H.; Quan, T.F.; A traffic sign detection method with high accuracy and efficiency; Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE): ; ,1426-1429.
[9] Yang, Y.; Wu, F.C.; Real-time traffic sign detection via color probability model and integral channel features; Proceedings of the 6th Chinese Conference on Pattern Recognition (CCPR): ; ,545-554.
[10] Wang, G.Y.; Ren, G.H.; Wu, Z.L.; A fast and robust ellipse-detection method based on sorted merging; Sci. World J.: 2014; .
[11] Liang, M.; Yuan, M.; Hu, X.; Traffic sign detection by ROI extraction and histogram features-based recognition; Proceedings of the International Joint Conference on Neural Networks: ; .
[12] Wang, G.Y.; Ren, G.H.; Wu, Z.L.; Zhao, Y.Q.; Jiang, L.H.; A robust, coarse-to-fine traffic sign detection method; Proceedings of the 2013 International Joint Conference on Neural Networks: ; ,754-758.
[13] Xiao, Z.T.; Yang, Z.J.; Geng, L.; Traffic sign detection based on histograms of oriented gradients and boolean convolutional neural networks; Proceedings of the International Conference on Machine Vision and Information Technology (CMVIT): ; ,111-115.
[14] Mogelmose, A.; Liu, D.R.; Trivedi, M.M.; Detection of U.S. traffic signs; IEEE Trans. Intell. Transp. Syst.: 2015; Volume 16 ,3116-3125.
[15] Girshick, R.; Donahue, J.; Darrell, T.; Malik, J.; Rich feature hierarchies for accurate object detection and semantic segmentation; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: ; ,580-587.
[16] He, K.M.; Zhang, X.Y.; Ren, S.Q.; Sun, J.; Spatial pyramid pooling in deep convolutional networks for visual recognition; IEEE Trans. Pattern Anal. Mach. Intell.: 2015; Volume 37 ,1904-1916.
[17] Girshick, R.; Fast R-CNN; Proceedings of the IEEE International Conference on Computer Vision: ; ,1440-1448.
[18] Ren, S.Q.; He, K.M.; Girshick, R.; Sun, J.; Faster R-CNN: Towards real-time object detection with region proposal networks; IEEE Trans. Pattern Anal. Mach. Intell.: 2017; Volume 39 ,1137-1149.
[19] Liu, W.; Anguelov, D.; Erhan, D.; Szegedy, C.; SSD: Single shot multibox detector; Proceedings of the 14th European Conference on Computer Vision (ECCV): ; ,21-37.
[20] Chang, X.J.; Ma, Z.G.; Yang, Y.; Zeng, Z.Q.; Bi-level semantic representation analysis for multimedia event detection; IEEE Trans. Cybern.: 2017; Volume 47 ,1180-1197.
[21] Chang, X.J.; Yu, Y.L.; Yang, Y.; Semantic Pooling for Complex Event Analysis in Untrimmed Videos; IEEE Trans. Pattern Anal. Mach. Intell.: 2017; Volume 39 ,1617-1632.
[22] Chang, X.J.; Yang, Y.; Semi-supervised feature analysis by mining correlations among multiple tasks; IEEE Trans. Neural Netw. Learn. Syst.: 2017; Volume 28 ,2294-2305.
[23] Hamed, H.A.; Elnaz, J.H.; Domenec, P.; A practical approach for detection and classification of traffic signs using Convolutional Neural Networks; Robot. Autom. Syst.: 2016; Volume 84 ,97-112.
[24] Qian, R.Q.; Zhang, B.L.; Yue, Y.; Robust Chinese traffic sign detection and recognition with deep convolutional neural network; In Proceedings of 11th International Conference on Natural Computation: ; ,791-796.
[25] Zhu, Z.; Huang, X.L.; Liang, D.; Traffic-Sign detection and classification in the wild; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: ; ,2110-2118.
[26] Xiong, C.Z.; Wang, C.; Ma, W.X.; Shan, Y.M.; A traffic sign detection algorithm based on deep convolutional neural network; Proceedings of the IEEE International Conference on Signal and Image Processing: ; ,676-679.
[27] Zeiler, M.D.; Fergus, R.; Visualizing and understanding convolutional networks; Proceedings of the 13th European Conference on Computer Vision (ECCV): ; ,818-833.
[28] Lecun, Y.; Bottou, L.; Bengio, Y.; Haffner, P.; Gradient-based learning applied to document recognition; Proc. IEEE: 1998; Volume 86 ,2278-2324.
[29] Krizhevsky, A.; Sutskever, I.; Hinton, G.E.; ImageNet classification with deep convolutional neural networks; Commun. ACM: 2017; Volume 60 ,84-90.
[30] Simonyan, K.; Zisserman, A.; Very deep convolutional networks for large-scale image recognition; arXiv: 2015; .
[31] Szegedy, C.; Liu, W.; Jia, Y.Q.; Going deeper with convolutions; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: ; .
[32] He, K.M.; Zhang, X.Y.; Ren, S.Q.; Sun, J.; Deep residual learning for image recognition; Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition: ; ,770-778.
[33] Lin, M.; Chen, Q.; Yan, S.C.; Network in network; arXiv: 2013; .
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.