Activity classification and anomaly detection using \(m\)-mediods based modelling of motion patterns. (English) Zbl 1213.68532

Khalid, Shehzad

Pattern Recognition 43, No. 10, 3636-3647 (2010).

Summary: Techniques for video object motion analysis, behaviour recognition and event detection are becoming increasingly important with the rapid increase in demand for and deployment of video surveillance systems. Motion trajectories provide rich spatiotemporal information about an object’s activity. This paper presents a novel technique for classification of motion activity and anomaly detection using object motion trajectory. In the proposed motion learning system, trajectories are treated as time series and modelled using modified DFT-based coefficient feature space representation. A modelling technique, referred to as \(m\)-mediods, is proposed that models the class containing \(n\) members with \(m\) mediods. Once the \(m\)-mediods based model for all the classes have been learnt, the classification of new trajectories and anomaly detection can be performed by checking the closeness of said trajectory to the models of known classes. A mechanism based on agglomerative approach is proposed for anomaly detection. Four anomaly detection algorithms using \(m\)-mediods based representation of classes are proposed. These includes: (i)global merged anomaly detection (GMAD), (ii) localized merged anomaly detection (LMAD), (iii) global un-merged anomaly detection (GUAD), and (iv) localized un-merged anomaly detection (LUAD). Our proposed techniques are validated using variety of simulated and complex real life trajectory datasets.

MSC:

68T10

Pattern recognition, speech recognition

Keywords:

object trajectory; dimensionality reduction; trajectory modelling; event mining; anomaly detection; motion recognition

References:

[1]	Aghbari, Z.; Kaneko, K.; Makinouchi, A., Content-trajectory approach for searching video databases, IEEE Transaction on Multimedia, 5, 4, 516-531 (2003)
[2]	Chang, S. F.; Chen, W.; Horace, J. M.; Sundaram, H.; Zhong, D., A fully automated content based video search engine supporting spatiotemporal queries, IEEE Transactions on Circuits and System for Video Technology, 8, 5, 602-615 (1998)
[3]	Dagtas, S.; Ali-Khatib, W.; Ghafor, A.; Kashyap, R. L., Models for motion-based video indexing and retrieval, IEEE Transactions on Image Processing, 9, 1, 88-101 (2000)
[4]	Hsu, C. T.; Teng, S. J., Motion trajectory based video indexing and retrieval, IEEE International Conference on Image Processing, 1, 605-608 (2002)
[7]	Shim, C.; Chang, J., Trajectory based video retrieval for multimedia information systems, (Proceedings of ADVIS (2004)), 372-382
[8]	Johnson, N.; Hogg, D., Learning the distribution of object trajectories for event recognition, (Proceedings of British Conference on Machine Vision (1995)), 582-592
[9]	Hu, W.; Xiao, X.; Xie, D.; Tan, T.; Maybank, S., Traffic accident prediction using 3-D model based vehicle tracking, IEEE Transactions on Vehicular Technology, 53, 3, 677-694 (2004)
[13]	Hu, W.; Xie, D.; Tan, T.; Maybank, S., Learning activity patterns using fuzzy self-organizing neural networks, IEEE Transactions on Systems, Man and Cybernetics, 34, 3, 1618-1626 (2004)
[17]	Shim, C.; Chang, J., Content based retrieval using trajectories of moving objects in video databases, (Proceedings of IEEE 7th International Conference on Database Systems for Advanced Applications (2001)), 169-170
[21]	Roberts, S.; Tarassenko, L., A probabilistic resource allocating network for novelty detection, Neural Computation, 6, 270-284 (1994)
[26]	Yacoob, Y.; Black, M. J., Parameterized modeling and recognition of activities, Computer Vision and Image Understanding, 73, 2, 232-247 (1999)
[27]	Bashir, F. I.; Khokhar, A. A.; Schonfeld, D., Object trajectory-based activity classification and recognition using hidden Markov models, IEEE Transactions on Image Processing, 16, 7, 1912-1919 (2007)
[28]	Hu, W.; Xiao, X.; Fu, Z.; Xie, D.; Tan, T.; Maybank, S., A system for learning statistical motion patterns, IEEE Transactions on Pattern Analysis and Machine Learning, 28, 9, 1450-1464 (2006)
[30]	Khalid, S.; Naftel, A., Classifying spatiotemporal object trajectories using unsupervised learning in the coefficient feature space, Multimedia Systems, 12, 3, 227-238 (2006)
[33]	Martinetz, T. M.; Berkovich, S. G.; Schulten, K. J., Neural-gas network for vector quantization and its application to time-series prediction, IEEE Transactions on Neural Networks, 4, 4, 558-569 (1993)