zbMATH — the first resource for mathematics

Real-time traffic sign recognition from video by class-specific discriminative features. (English) Zbl 1187.68498
Summary: We address the problem of traffic sign recognition. Novel image representation and discriminative feature selection algorithms are utilised in a traditional three-stage framework involving detection, tracking and recognition. The detector captures instances of equiangular polygons in the scene which is first appropriately filtered to extract the relevant colour information and establish the regions of interest. The tracker predicts the position and the scale of the detected sign candidate over time to reduce computation. The classifier compares a discrete-colour image of the observed sign with the model images with respect to the class-specific sets of discriminative local regions. They are learned off-line from the idealised template sign images, in accordance with the principle of one-vs-all dissimilarity maximisation. This dissimilarity is defined based on the so-called Colour Distance Transform which enables robust discrete-colour image comparisons. It is shown that compared to the well-established feature selection techniques, such as Principal Component Analysis or AdaBoost, our approach offers a more adequate description of signs and involves effortless training. Upon this description we have managed to build an efficient road sign recognition system which, based on a conventional nearest neighbour classifier and a simple temporal integration scheme, demonstrates a competitive performance in the experiments involving real traffic video.

68T10 Pattern recognition, speech recognition
Full Text: DOI
[1] Kalman, R.E., A new approach to linear filtering and prediction problems, Transactions of the ASME journal of basic engineering, 82, 35-45, (1960)
[2] Dempster, A.; Laird, N.; Rubin, D., Maximum likelihood from incomplete data via the EM algorithm, Journal of the royal statistical society (B), 39, 1, 138, (1977) · Zbl 0364.62022
[3] Borgefors, G., Distance transformations in digital images, Computer vision, graphics, and image processing, 34, 3, 344-371, (1986)
[4] Titterington, D.M., Statistical analysis of finite mixture distributions, (1986), Wiley New York · Zbl 0714.62023
[5] Rubin, D.B., Using the SIR algorithm to simulate posterior distributions, Bayesian statistics, 3, 395-402, (1988) · Zbl 0713.62035
[6] Pudil, P.; Novovicová, J.; Kittler, J., Floating search methods in feature selection, Pattern recognition letters, 15, 11, 1119-1125, (1994)
[7] Piccioli, G.; De Micheli, E.; Parodi, P.; Campani, M., A robust method for road sign detection and recognition, Image and vision computing, 14, 3, 209-223, (1996)
[8] Y. Aoyagi, T. Asakura, A study on traffic sign recognition in scene image using genetic algorithms and neural networks, in: Proceedings of the 1996 IEEE IECON 22nd International Conference on Industrial Electronics, Control, and Instrumentation, vol. 3, 1996, pp. 1838-1843.
[9] de la Escalera, A.; Moreno, L.E.; Salichs, M.A.; Armingol, J.M., Road traffic sign detection and classification, IEEE transactions on industrial electronics, 44, 6, 848-859, (1997)
[10] D. Gavrila, Multi-feature hierarchical template matching using distance transforms, in: Proceedings of the IEEE International Conference on Pattern Recognition, Brisbane, Australia, 1998, pp. 439-444.
[11] Akmal Butt, M.; Maragos, P., Optimum design of chamfer distance transforms, IEEE transactions on image processing, 7, 10, 1477-1484, (1998)
[12] L. Zhang, F. Lin, B. Zhang, A CBIR method based on color-spatial feature, in: Proceedings of the IEEE Region 10 Conference TENCON 99, vol. 1, 1999, pp. 166-169.
[13] Paclík, P.; Novovicova, J.; Pudil, P.; Somol, P., Road signs classification using the Laplace kernel classifier, Pattern recognition letters, 21, 13-14, 1165-1173, (2000) · Zbl 0985.68702
[14] Douville, P., Real-time classification of traffic signs, Real-time imaging, 6, 3, 185-193, (2000)
[15] J. Miura, T. Kanda, Y. Shirai, An active vision system for real-time traffic sign recognition, in: Proceedings of the IEEE Conference on Intelligent Transportation Systems, Darborn, MI, USA, 2000, pp. 52-57.
[16] Kadir, T.; Brady, M., Scale, saliency and image description, International journal of computer vision, 45, 2, 83-105, (2001) · Zbl 0987.68597
[17] Fang, C.-Y.; Chen, S.-W.; Fuh, C.-S., Roadsign detection and tracking, IEEE transactions on vehicular technology, 52, 5, 1329-1341, (2003)
[18] M. Jones, P. Viola, Face recognition using boosted local features. Technical Report TR2003-25, 2003.
[19] Lowe, D.G., Distinctive image features from scale-invariant keypoints, International journal of computer vision, 60, 2, 91-110, (2004)
[20] H. Fleyeh, Color detection and segmentation for road and traffic signs, in: Proceedings of the IEEE Conference on Cybernetics and Intelligent Systems, Singapore, vol. 2, 2004, pp. 809-814.
[21] Viola, P.; Jones, M., Robust real-time object detection, International journal of computer vision, 57, 2, 137-154, (2004)
[22] de la Escalera, A.; Armingol, J.M.; Pastor, J.M.; Rodríguez, F.J., Visual sign information extraction and identification by deformable models for intelligent vehicles, IEEE transactions on intelligent transportation systems, 5, 2, 57-68, (2004)
[23] G. Loy, N. Barnes, D. Shaw, A. Robles-Kelly, Regular polygon detection, in: Proceedings of the 10th IEEE International Conference on Computer Vision, vol. 1, 2005, pp. 778-785.
[24] C. Bahlmann, Y. Zhu, V. Ramesh, M. Pellkofer, T. Koehler, A system for traffic sign detection, tracking and recognition using color, shape, and motion information, in: Proceedings of the IEEE Intelligent Vehicles Symposium, 2005, pp. 255-260.
[25] Gao, X.W.; Podladchikova, L.; Shaposhnikov, D.; Hong, K.; Shevtsova, N., Recognition of traffic signs based on their colour and shape features extracted using human vision models, Journal of visual communication and image representation, 17, 4, 675-685, (2006)
[26] M.A. Garcia-Garrido, M.A. Sotelo, E. Martin-Gorostiza, Fast traffic sign detection and recognition under changing lighting conditions, in: Proceedings of the IEEE International Conference on Intelligent Transportation Systems, 2006, pp. 811-816.
[27] Paclík, P.; Novovicová, J.; Duin, R.P.W., Building road-sign classifiers using a trainable similarity measure, IEEE transactions on intelligent transportation systems, 7, 3, 309-321, (2006)
[28] A. Ruta, Y. Li, X. Liu, Towards real-time traffic sign recognition by class-specific discriminative features, in: Proceedings of the 18th British Machine Vision Conference, Coventry, United Kingdom, vol. 1, 2007, pp. 399-408.
[29] A. Ruta, Y. Li, X. Liu, Traffic sign recognition using discriminative local features, in: Proceedings of the 7th International Symposium on Intelligent Data Analysis, Ljubljana, Slovenia, 2007, pp. 355-366.
[30] B. Mecánico, Road signs arranged by country. [www] Available from: \(\langle\)http://www.elve.net/rcoulst.htm⟩ [Accessed September 22, 2008].
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.