Periodicity detection in irregularly sampled light curves by robust regression and outlier detection. (English) Zbl 07260353

Summary: An important task in astroparticle physics is the detection of periodicities in irregularly sampled time series, called light curves. Many periodogram methods for light curves may be characterized as fitting periodic models using least squares regression. We generalize this approach and allow robust regression and weighted regression. This gives a unified concept which includes further methods proposed in the literature, allows to create new methods and take additional information about measurement accuracies into account. We compare all these methods using simulated data. We observe that if the quality of the measurement accuracies is dubious, they should be ignored, and that robust methods can be helpful if the light curve contains outliers. Finally, we propose a new way to determine valid periods by robust fitting of a distribution to the periodogram and outlier detection. In our simulations, this leads to better detection rates for periodic fluctuations with unexpected shape and less wrong detections in light curves of pure red and white noise.


62-XX Statistics
68-XX Computer science
Full Text: DOI


[1] M. Ahdesm¨aki, H. L¨ahdesm¨aki, A. Gracey, I. Shmulevich, and O. Yli-Harja, Robust regression for periodicity detection in non-uniformly sampled time-course gene expression data, BMC Bioinform 8(1) (2007), 233.
[2] S. Baisch and G. H. R. Bokelmann, Spectral analysis with incomplete time series: an example from seismology∗1, Comput Geosci 25(7) (1999), 739-750.
[3] T. Ruf, The Lomb-Scargle periodogram in biological rhythm research: analysis of incomplete and unequally spaced timeseries, Biol Rhythm Res 30(2) (1999), 178-201.
[4] P. Fortin and M. C. Mackey, Periodic chronic myelogenous leukaemia: spectral analysis of blood cell counts and aetiological implications, Br J Haematol 104(2) (1999), 336-345.
[5] M. Mudelsee, D. Scholz, R. R¨othlisberger, D. Fleitmann, A. Mangini, and E. W. Wolff, Climate spectrum estimation in the presence of timescale errors, Nonlin Process Geophys 16 (2009), 43-56.
[6] D. Kranich, O. de Jager, M. Kestel, and E. Lorenz, QPO analysis of the TeV and X-ray lightcurve of Mkn 501 in 1997-final results, In Proceedings of ICRC, Vol. 2001, 2001, 2630.
[7] M. Tluczykont, E. Bernardini, K. Satalecka, R. Clavero, M. Shayduk, and O. Kalekin, Long-term lightcurves from combined unified very high energy gamma-ray data, Astron Astrophys 524 (2010), A48. Available: http://nuastrozeuthen.desy.de/magic_experiment/projects/light_curve_archive.
[8] J. Albert, E. Aliu, H. Anderhub, P. Antoranz, A. Armada, M. Asensio, C. Baixeras, J. A. Barrio, M. Bartelt, H. Bartko, D. Bastieri, S. R. Bavikadi, W. Bednarek, K. Berger, C. Bigongiari, A. Biland, E. Bisesi, R. K. Bock, P. Bordas, V. Bosch-Ramon, T. Bretz, I. Britvitch, M. Camara, E. Carmona, A. Chilingarian, S. Ciprini, J. A. Coarasa, S. Commichau, J. L. Contreras, J. Cortina, V. Curtef, V. Danielyan, F. Dazzi, A. De Angelis, R. de los Reyes, B. De Lotto, E. Domingo-Santamar´ıa, D. Dorner, M. Doro, M. Errando, M. Fagiolini, D. Ferenc, E. Fern´andez, R. Firpo, J. Flix, M. V. Fonseca, L. Font, M. Fuchs, N. Galante, M. Garczarczyk, M. Gaug, M. Giller, F. Goebel, D. Hakobyan, M. Hayashida, T. Hengstebeck, D. H¨ohne, J. Hose, C. C. Hsu, P. G. Isar, P. Jacon, O. Kalekin, R. Kosyra, D. Kranich, M. Laatiaoui, A. Laille, T. Lenisa, P. Liebing, E. Lindfors, S. Lombardi, F. Longo, J. L´opez, M. L´opez, E. Lorenz, F. Lucarelli, P. Majumdar, G. Maneva, K. Mannheim, O. Mansutti, M. Mariotti, M. Mart´ınez, K. Mase, D. Mazin, C. Merck, M. Meucci, M. Meyer, J. M. Miranda, R. Mirzoyan, S. Mizobuchi, A. Moralejo, K. Nilsson, E. O˜na-Wilhelmi, R. Ordu˜na, N. Otte, I. Oya, D. Paneque, R. Paoletti, J. M. Paredes, M. Pasanen, D. Pascoli, F. Pauss, N. Pavel, R. Pegna, M. Persic, L. Peruzzo, A. Piccioli, M. Poller, G. Pooley, E. Prandini, A. Raymers, W. Rhode, M. Rib´o, J. Rico, B. Riegel, M. Rissi, A. Robert, G. E. Romero, S. R¨ugamer, A. Saggion,
[9] J. Albert, E. Aliu, H. Anderhub, L. A. Antonelli, P. Antoranz, M. Backes, C. Baixeras, J. A. Barrio, H. Bartko, D. Bastieri, J. K. Becker, W. Bednarek, K. Berger, E. Bernardini, C. Bigongiari, A. Biland, R. K. Bock, G. Bonnoli, P. Bordas, V. Bosch-Ramon, T. Bretz, I. Britvitch, M. Camara, E. Carmona, A. Chilingarian, S. Commichau, J. L. Contreras, J. Cortina, M. T. Costado, S. Covino, V. Curtef, F. Dazzi, A. De Angelis, E. De Cea del Pozo, R. de los Reyes, B. De Lotto, M. De Maria, F. De Sabata, C. Delgado Mendez, A. Dominguez, D. Dorner, M. Doro, M. Errando, M. Fagiolini, D. Ferenc, E. Fern´andez, R. Firpo, M. V. Fonseca, L. Font, N. Galante, R. J. Garc´ıa L´opez, M. Garczarczyk, M. Gaug, F. Goebel, M. Hayashida, A. Herrero, D. H¨ohne, J. Hose, C. C. Hsu, S. Huber, T. Jogler, D. Kranich, A. La Barbera, A. Laille, E. Leonardo, E. Lindfors, S. Lombardi, F. Longo, M. L´opez, E. Lorenz, P. Majumdar, G. Maneva, N. Mankuzhiyil, K. Mannheim, L. Maraschi, M. Mariotti, M. Mart´ınez, D. Mazin, M. Meucci, M. Meyer, J. M. Miranda, R. Mirzoyan, S. Mizobuchi, M. Moles, A. Moralejo, D. Nieto, K. Nilsson, J. Ninkovic, N. Otte, I. Oya, M. Panniello, R. Paoletti, J. M. Paredes, M. Pasanen, D. Pascoli, F. Pauss, R. G. Pegna, M. A. Perez-Torres, M. Persic, L. Peruzzo, A. Piccioli, F. Prada, E. Prandini, N. Puchades, A. Raymers, W. Rhode, M. Rib´o, J. Rico, M. Rissi, A. Robert, S. R¨ugamer, A. Saggion, T. Y. Saito, M. Salvati, M. Sanchez-Conde, P. Sartori, K. Satalecka, V. Scalzotto, V. Scapin, R. Schmitt, T. Schweizer, M. Shayduk, K. Shinozaki, S. N. Shore, N. Sidro, A. Sierpowska-Bartosik, A. Sillanp¨a¨a, D. Sobczynska, F. Spanier, A. Stamerra, L. S. Stark, L. Takalo, F. Tavecchio, P. Temnikov, D. Tescaro, M. Teshima, M. Tluczykont, D. F. Torres, N. Turini, H. Vankov, A. Venturini, V. Vitale, R. M. Wagner, W. Wittek, V. Zabalza, F. Zandanel, R. Zanin and J. Zapatero, Periodic very high energyγ-ray emission from LS I+61 303 observed with the magic telescope, Astrophys J 693(1) (2009), 303.
[10] F. M. Rieger, and K. Mannheim, Implications of a possible 23 day periodicity for binary black hole models in mkn 501, Astron Astrophys 359 (2000), 948-952.
[11] J. D. Scargle, Studies in astronomical time series analysis. II-Statistical aspects of spectral analysis of unevenly spaced data, Astrophys J 263 (1982), 835-853.
[12] M. Zechmeister, and M. K¨urster, The generalised LombScargle periodogram. A new formalism for the floatingmean and Keplerian periodograms, Astron Astrophys 496 (2009), 577-584.
[13] D. A. Leahy, W. Darbro, R. F. Elsner, M. C. Weisskopf, S. Kahn, P. G. Sutherland, and J. E. Grindlay, On searches for pulsed emission with application to four globular cluster X-ray sources-NGC 1851, 6441, 6624, and 6712, Astrophys J 266 (1983), 160-170.
[14] R. F. Stellingwerf, Period determination using phase dispersion minimization, Astrophys J 224 (1978), 953-960.
[15] A. Schwarzenberg-Czerny, On the advantage of using analysis of variance for period search, Mon Not R Astron Soc 241 (1989), 153-165.
[16] B. H. Andrew, J. M. MacLeod, J. L. Locke, and W. J. Medd, Rapid radio variations in BL Lac, Nature 223 (1969), 598-599.
[17] J. Timmer and M. K¨onig, On generating power law noise, Astron Astrophys 300 (1995), 707-710.
[18] T. J. Deeming, Fourier analysis with unequally-spaced data, Astrophys Space Sci 36(1) (1975), 137-158. · Zbl 0304.42026
[19] P. Hall and M. Li, Using the periodogram to estimate period in nonparametric regression, Biometrika 93(2) (2006), 411-424. · Zbl 1153.62030
[20] P. J. Huber and E. Ronchetti, Robust Statistics (2nd ed.), New Jersey, Wiley, 2009. · Zbl 1276.62022
[21] J. McDonald, Periodic smoothing of time series, SIAM J Sci Stat Comput 7(2) (1986), 665-688. · Zbl 0628.65148
[22] J. D. Reimann, Frequency Estimation Using UnequallySpaced Astronomical Data. PhD Thesis, University of California at Berkeley, 1994.
[23] A. Cumming, G. W. Marcy, and R. P. Butler, The lick planet search: detectability and mass thresholds, Astrophys J 526 (1999), 890-915.
[24] D. M. Palmer, A fast Chi-squared technique for period search of irregularly sampled data, Astrophys J 695 (2009), 496.
[25] H. S. Oh, D. Nychka, T. Brown, and P. Charbonneau, Period analysis of variable stars by robust smoothing, J R Stat Soc C 53(1) (2004), 15-30. · Zbl 1111.85302
[26] P. Hall, J. Reimann, and J. Rice, Nonparametric estimation of a periodic function, Biometrika 87(3) (2000), 545. · Zbl 0956.62031
[27] S. Ferraz-Mello, Estimation of periods from unequally spaced observations, Astron J 86 (1981), 619.
[28] P. Reegen, SigSpec I. Frequency-and phase-resolved significance in Fourier space, Astron Astrophys 467 (2007), 1353-1371.
[29] A. Schwarzenberg-Czerny, The distribution of empirical periodograms: Lomb-Scargle and PDM spectra, Mon Not R Astron Soc 301(3) (1998), 831-840.
[30] R. Renson, M´ethode de recherche des p´eriodes des ´etoiles variables, Astron Astrophys 63 (1978), 125-129.
[31] M. M. Dworetsky, A period-finding method for sparse randomly spaced observations or ‘How long is a piece of string?’, Mon Not R Astron Soc 203 (1983), 917-924.
[32] T. H. Li, A robust spectral analyzer for one-dimensional and multi-dimensional data analysis, 2009/0112954 A1, April 2009. US Patent Application.
[33] T. H. Li, A nonlinear method for robust spectral analysis, IEEE Trans Signal Process 58(5) (2010), 2466-2474. · Zbl 1392.94301
[34] Z. Zhang and S. C. Chan, Robust adaptive Lomb periodogram for time-frequency analysis of signals with sinusoidal and transient components, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP’05), Vol. 4, 2005. iv-493.
[35] P. J. Rousseeuw, Least median of squares regression, J Am Stat Assoc 79(388) (1984), 871-880. · Zbl 0547.62046
[36] P. J. Rousseeuw, S. Van Aelst, K. Van Driessen, and J. A. Gull´o, Robust multivariate regression, Technometrics 46(3) (2004), 293-305.
[37] P. M. Hooper, Period analysis of variable stars: temporal dependence and local optima, Comput Stat Data Anal 51(12) (2007), 6070-6083. · Zbl 1445.85004
[38] R. A. Maronna and V. J. Yohai, Robust regression with both continuous and categorical predictors, J Stat Plan Inference 89(1-2) (2000), 197-214. · Zbl 0954.62030
[39] R Development Core Team.R: a language and environment for statistical computing, R Foundation for Statistical Computing, Vienna, Austria, 2007.
[40] W. N. Venables and B. D. Ripley, Modern Applied Statistics with S, (4th ed.), New York, Springer, 2002, ISBN 0-38795457-0. · Zbl 1006.62003
[41] R. Koenker,quantreg: Quantile regression, 2011. R package version 4.57. · Zbl 1236.62031
[42] P. Rousseeuw, C. Croux, V. Todorov, A. Ruckstuhl, M. Salibian,-Barrera, T. Verbeke, M. Koller, and M. Maechler,, robustbase: Basic robust statistics. R package version 0.7-8., 2011.
[43] F. A. M. Frescura, C. A. Engelbrecht, and B. S. Frank, Significance tests for periodogram peaks. Arxiv preprint, 2007. Available: http://arxiv.org/abs/0706.2225.
[44] G. A. F. Seber, and A. J. Lee, Linear Regression Analysis (2nd ed.), Hoboken, New Jersey, John Wiley & Sons, 2003, 112. · Zbl 1029.62059
[45] A. K. Gupta and S. Nadarajah, Handbook of Beta Distribution and Its Applications, Vol. 174, 51, New York, CRC, 2004. · Zbl 1062.62021
[46] B. R. Clarke, P. L. McKinnon, and G. Riley, A fast robust method for fitting gamma distributions, Stat Pap 53 (2012), 1001-1014. · Zbl 1254.62066
[47] L. Davies and U. Gather, The identification of multiple outliers, J Am Stat Assoc 88(423) (1993), 782-792. · Zbl 0797.62025
[48] T. Do, A. M. Ghez, M. R. Morris, S. Yelda, L. Meyer, J. R. Lu, S. D. Hornstein, and K. Matthews, A near-infrared variability study of the Galactic black hole: a red noise source with no detected periodicity, Astrophys J 691(2) (2009), 1021-1034.
[49] J. P. Halpern, K. M. Leighly, and H. L. Marshall, An extreme ultraviolet explorer atlas of Seyfert galaxy light curves: search for periodicity, Astrophys J 585 (2003), 665-676.
[50] M. Zamaninasab, A. Eckart, G. Witzel, M. Dovciak, V. Karas, R. Sch¨odel, R. Gieߨubel, M. Bremer, M. GarcıaMarın, D. Kunneriath, K. Muˇzic, S. Nishiyama, N. Sabha, C. Straubmeier, and A. Zensus, Near infrared flares of Sagittarius A*, Astron Astrophys 510 (2010), A3.
[51] S. Vaughan, R. Edelson, R. S. Warwick, and P. Uttley, On characterizing the variability properties of X-ray light curves from active galaxies, Mon Not R Astron Soc 345(4) (2003), 1271-1284.
[52] P. Uttley, I. M. McHardy, and I. E. Papadakis, Measuring the broad-band power spectra of active galactic nuclei with RXTE, Mon Not R Astron Soc 332(1) (2002), 231-250.
[53] Y.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. It attempts to reflect the references listed in the original paper as accurately as possible without claiming the completeness or perfect precision of the matching.