Statistical consistency of the data association problem in multiple target tracking. (English) Zbl 1329.60108

Summary: Simultaneous tracking of multiple moving objects extracted from an image sequence is an important problem which finds numerous applications in science and engineering. In this article we conduct an investigation of the theoretical properties a statistical model for tracking such moving objects, or targets. This tracking model allows for birth, death, splitting and merging of targets, and uses a Markov model to decide the times at which such events occur. This model also assumes that the track traveled by each target behaves like a Gaussian process. The estimated tracking solution is obtained via maximum likelihood. One of the contributions of this article is to establish the almost sure consistency to the data association problem by using these maximum likelihood tracking estimates. A major technical challenge for proving this consistency result is to identify the correct track (data association) amongst a group of similar (but incorrect) track proposals that are results of various combinations of target birth, death, splitting and/or merging. This consistency property of the tracking estimates is empirically verified by numerical experiments. To the best of our knowledge, this is the first time that a comprehensive study is performed for the large sample properties of a multiple target tracking method. In addition, the issue of how to quantify the confidence of a tracking estimate is also addressed.


60G35 Signal detection and filtering (aspects of stochastic processes)
60G17 Sample path properties
60G15 Gaussian processes
62M20 Inference from stochastic processes and prediction
Full Text: DOI Euclid


[1] Bar-Shalom, Y., Li, X. & Kirubarajan, T. (2001), Estimation with Applications to Tracking and Navigation , John Wiley & Sons, Inc., New York, NY. · Zbl 0994.62053
[2] Blackman, S. (2004), ‘Multiple hypothesis tracking for multiple target tracking’, IEEE A&E Systems Magazine 19 , 5-18.
[3] Blackman, S. & Popoli, R. (1999), Design and Analysis of Modern Tracking Systems , Artech House, Boston. · Zbl 0933.93002
[4] Chang, K. & Bar-Shalom, Y. (1984), ‘Joint probabilistic data association for multitarget tracking with possibly unresolved measurements and maneuvers’, IEEE Transactions on Automatic Control 29 , 585-594. · Zbl 0541.93064
[5] Chen, H., Li, X. & Bar-Shalom, Y. (2004), ‘On joint track initiation and parameter estimation under measurement origin uncertainty’, IEEE Transactions on Aerospace and Electronic Systems 40 , 675-694.
[6] Cong, S. & Hong, L. (1999), ‘Computational complexity analysis for multiple hypothesis tracking’, Mathematical and computer modeling 29 , 1-16. · Zbl 0992.65076 · doi:10.1016/S0895-7177(99)00077-1
[7] Daum, F. E. (1994), ‘The importance of resolution in multiple target tracking’, Signal and Data Processing of Small Targets 1994, SPIE Proceedings 2235 , 329-338.
[8] Doucet, A., de Freitas, N. & Gordon, N. (2001), Sequential Monte Carlo Methods in Practice , Springer Verlag, New York, NY. · Zbl 0967.00022
[9] Doucet, A., Godsill, S. & Andrieu, C. (2000), ‘On sequential Monte Carlo sampling methods for Bayesian methods’, Statistics and Computing 10 , 197-208.
[10] Fortmann, T., Bar-Shalom, Y. & Scheffe, M. (1983), ‘Sonar tracking of multiple targets using joint probabilistic data association’, IEEE Journal of Oceanic Engineering 8 , 173-184.
[11] Gelfand, A. (1990), ‘Sampling-based approaches to calculating marginal densities’, Journal of the American Statistical Association 85 (410), 398-409. · Zbl 0702.62020 · doi:10.2307/2289776
[12] Genovesio, A. & Olivo-Marin, J. (2004), ‘Split and merge data association filter for dense multi-target tracking’, Proceedings of the 17th International Conference on Pattern Recognition pp. 677-680.
[13] Gordon, N., Salmond, D. & Smith, A. (1993), ‘Novel approach to nonlinear/non-Gaussian Bayesian state estimation’, IEE Proceedings-F 140 , 107-113.
[14] Hall, P., Peng, L. & Rau, C. (2001), ‘Local likelihood tracking of fault lines and boundaries’, Journal of the Royal Statistical Society B 63 , 569-582. · Zbl 1040.62043 · doi:10.1111/1467-9868.00299
[15] Hall, P., Qiu, P. & Rau, C. (2007), ‘Tracking edges, corners and vertices in an image’. unpublished, manuscript. · Zbl 1164.62070
[16] Hall, P. & Rau, C. (2000), ‘Tracking a smooth fault line in a response surface’, Annals of Statistics 28 , 713-733. · Zbl 1105.62327 · doi:10.1214/aos/1015951995
[17] Kallenberg, O. (2002), Foundations of Modern Probability , 2nd edn, Springer-Verlag, New York, NY. · Zbl 0996.60001
[18] Khoshnevisan, D. (2002), Multiparameter Processes; An Introduction to Random Fields , Springer-Verlag, New York, NY. · Zbl 1005.60005 · doi:10.1007/b97363
[19] Kitagawa, G. (1996), ‘Monte Carlo filter and smoother for non-Gaussian nonlinear state models’, Journal of Computational and Graphical Statistics 5 , 1-25.
[20] Koch, W. & van Keuk, G. (1997), ‘Multiple hypothesis track maintenance with possibly unresolved measurements’, IEEE Transactions on Aerospace and Electronic Systems 33 , 883-892.
[21] Li, J. & Jing, Z. (2003), ‘Practical system for tracking multiple maneuvering targets’, Optical Engineering 42 , 2439-2451.
[22] Liu, J. & Chen, R. (1998), ‘Sequential monte carlo methods for dynamic systems’, Journal of the American Statistical Association 93 , 1032-1044. · Zbl 1064.65500 · doi:10.2307/2669847
[23] Mahler, R. (2003), ‘Multitarget Bayes filtering via first-order multitarget moments’, IEEE Transactions on Aerospace and Electronic Systems 39 , 1152-1178.
[24] Mori, S., Chong, C., Tse, E. & Wishner, R. (1986), ‘Tracking and classifying multiple targets without a priori identification’, IEEE Transactions on Automatic Control 31 , 401-409. · Zbl 0594.93058
[25] Reid, D. (1979), ‘An algorithm for tracking multiple targets’, IEEE Transactions on Automatic Control 24 , 843-854.
[26] Revuz, D. & Yor, M. (1999), Continuous Martingales and Brownian Motion , Springer-Verlag, New York, NY. · Zbl 0917.60006
[27] Shepp, L. (1966), ‘Radon nikodym derivatives of Gaussian measures’, Annals of Mathematical Statistics 37 , 321-354. · Zbl 0142.13901 · doi:10.1214/aoms/1177699516
[28] Storlie, C., Lee, T., Hannig, J. & Nychka, D. (2009), ‘Tracking of multiple merging and splitting targets: A statistical perspective (with discussion)’, Statistica Sinica 19 , 1-52. · Zbl 1154.62089
[29] Trunk, G. & Wilson, J. (1981), ‘Track initiation of occasionally unresolved radar targets’, IEEE Transactions on Aerospace and Electronic Systems 17 , 122-130.
[30] Vo, B., Singh, S. & Doucet, A. (2005), ‘Sequential Monte Carlo methods for Bayesian multitarget filtering with random finite sets’, IEEE Transactions on Aerospace and Electronic Systems 41 , 1224-1245.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.