×

Multi-intersection traffic light control with blocking. (English) Zbl 1320.90013

Summary: We address the traffic light control problem for multiple intersections in tandem by viewing it in a stochastic hybrid system setting and developing a Stochastic Flow Model (SFM) for it. Our model includes roads with finite vehicle capacity, which may lead to additional delays due to traffic blocking. Using Infinitesimal Perturbation Analysis (IPA), we derive on-line gradient estimators of an average traffic congestion metric with respect to the controllable green and red cycle lengths. The IPA estimators obtained require counting traffic light switchings and estimating car flow rates only when specific events occur. The estimators are used to iteratively adjust light cycle lengths to improve performance and, in conjunction with a standard gradient-based algorithm, to seek optimal values which adapt to changing traffic conditions. Simulation results are included to illustrate the approach.

MSC:

90B20 Traffic problems in operations research
60K30 Applications of queueing theory (congestion, allocation, storage, traffic, etc.)
93E03 Stochastic systems in control theory (general)
93C30 Control/observation systems governed by functional relations other than differential equations (such as hybrid and switching systems)
93C95 Application models in control theory
05C90 Applications of graph theory

Software:

UMDES
PDFBibTeX XMLCite
Full Text: DOI

References:

[1] Abdulhai B, Pringle R, Karakoulas G (2003) Reinforcement learning for true adaptive traffic signal control. J Transp Eng 129(3):278-285 · doi:10.1061/(ASCE)0733-947X(2003)129:3(278)
[2] Alvarez I, Poznyak A (2010) Game theory applied to urban traffic control problem. In: International conference on control, automation and systems, pp 2164-2169
[3] Bazzan AL (2009) Opportunities for multiagent systems and multiagent reinforcement learning in traffic control. Auton Agent Multi-Agent Syst 18:342-375 · doi:10.1007/s10458-008-9062-9
[4] Cassandras CG, Lafortune S (2008) Introduction to Discrete Event Systems, 2nd edn. Springer, Berlin · Zbl 1165.93001 · doi:10.1007/978-0-387-68612-7
[5] Cassandras CG, Lygeros J (2006) Stochastic hybrid systems. Taylor and Francis, New York · Zbl 1123.93004 · doi:10.1201/9781420008548
[6] Cassandras CG, Wardi Y, Melamed B, Sun G, Panayiotou CG (2002) Perturbation analysis for on-line control and optimization of stochastic fluid models. IEEE Trans Automat Control47 (8):1234-1248 · Zbl 1364.93494 · doi:10.1109/TAC.2002.800739
[7] Cassandras CG, Wardi Y, Panayiotou CG, Yao C (2010) Perturbation analysis and optimization of stochastic hybrid systems. Eur J Control 16(6):642-664 · Zbl 1216.93092 · doi:10.3166/ejc.16.642-661
[8] DeSchutter B (1999) Optimal traffic light control for a single intersection. Proc IEEE Am Control Conf 3:2195-2199
[9] Dong C (2004) Area traffic signal timing optimization based on chaotic and genetic algorithm approach. Comput Eng Appl 40(29):32-34
[10] Dong C (2006) Chaos-particle swarm optimization algorithm and its application to urban traffic control.Int J Comput Sci Netw Secur 6(1):97-101
[11] Dujardin Y, Boillot F, Vanderpooten D, Vinant P (2011) Multiobjective and multimodal adaptive traffic light control on single junctions. In: 14th IEEE conference on intelligent transportation systems, pp 1361-1368
[12] Findler N, Stapp J (1992) A distributed approach to optimized control of street traffic signals. J Transp Eng 118
[13] Gartner NH (1983) OPAC: a demand-responsive strategy for traffic signal control. Transp Res Rec 906:75-81
[14] Geng Y, Cassandras CG (2012a) Multi-intersection traffic light control using infinitesimal perturbation analysis. In: 11th international workshop on discrete event systems, pp 104-109
[15] Geng Y, Cassandras CG (2012b) Traffic light control using infinitesimal perturbation analysis. In: 51st IEEE conference on decision and control, pp 7001-7006
[16] Head L, Ciarallo F, Kaduwela V, Lucas D (1996) A perturbation analysis approach to traffic signal optimization. In: INFORMS National Meeting
[17] Henry JJ, Farges JL (1990) PRODYN control, computers, communications in transportation. Pergamon Press, New York, pp 253-255 · doi:10.1016/B978-0-08-037025-5.50043-8
[18] Hunt PB, Robertson DL, Bretherton RD (1982) The SCOOT on-line traffic signal optimization technique. Traffic Eng Control 23:190-192
[19] Lee JH, Lee K, Lee-Kwang H (1995) Fuzzy controller for intersection group. In: International IEEE/IAS conference on industrial automation and control, pp 376-382 · Zbl 1364.93494
[20] Liu Q, Lu H, Zou B, Li Q (2006) Design and development of parkking guidance information system based on web and gis technology. In: 6th international conference on ITS telecommunications, pp 1263-1266 · Zbl 1225.93106
[21] Lowrie PR (1982) SCATS principles, methodology, algorithm. In: IEE conference on road traffic signalling, pp 67-70
[22] Murat YS, Gedizlioglu E (2005) A fuzzy logic multi-phased signal control model for isolated junctions. Transp Res Part C 18:19-36 · doi:10.1016/j.trc.2004.12.004
[23] Nakatsuyama M, Nagahashi H, Nishizuka N (1984) Fuzzy logic phase controller for traffic junctions in the one-way arterial road. In: IFAC 9th triennial world cong, pp 2865-2870
[24] Niittymaki J, Nevala R, Turunen E (2002) Fuzzy traffic signal control and a new interface method-maximal fuzzy similarity. In: Proceedings of the 13th Mini-EURO Conference, pp 716-728
[25] Panayiotou CG, Howell WC, Fu M (2005) Online traffic light control through gradient estimation using stochastic fluid models. In: Proceedings of the IFAC 16th triennial world congress
[26] Papageorgiou M, Diakaki C, Dinopoulou V, Kotsialos A, Wang Y (2003) Review of road traffic control strategies. Proc IEEE 91(12):2043-2067 · doi:10.1109/JPROC.2003.819610
[27] Pappis C, Mamdani E (1977) A fuzzy logic controller for a traffic junction. IEEE Trans Syst Man Cybern SMC-7 7(10):707-717 · Zbl 0372.90055 · doi:10.1109/TSMC.1977.4309605
[28] Porche I, Lafortune S (1999) Adptive look-ahead optimization of traffic signals. ITS J 4:209-254
[29] Prashanth LA, Bhatnagar S (2011) Reinforcement learning with function approximation for traffic signal control. IEEE Trans Intell Transp Syst 12(2):412-421 · doi:10.1109/TITS.2010.2091408
[30] Robertson DI, Bretherton RD (1991) Optimizing networks of traffic signals in real-time: the SCOOT method. IEEE Trans Veh Technol 40(1):11-15 · doi:10.1109/25.69966
[31] Sen S, Head L (1997) Controlled optimization of phases at an intersection. Transp Sci 31:5-17 · Zbl 0888.90063 · doi:10.1287/trsc.31.1.5
[32] Thorpe T (1997) Vehicle traffic light control using sarsa. Master thesis, Department of Computer Science, Colorado State Univ
[33] Trabia MB, Kaseko MS, Ande M (1996) A two-stage fuzzy logic controller for traffic signals. Transp Res Part C 7(6):353-367 · doi:10.1016/S0968-090X(99)00026-1
[34] Wardi Y, Adams R, Melamed B (2010) A unified approach to infinitesimal perturbation analysis in stochastic flow models: the single-stage case. IEEE Trans Automat Control 55(1):89-103 · Zbl 1368.93403 · doi:10.1109/TAC.2009.2034228
[35] Wei W, Zhang Y, Mbede JB, Zhang Z, Song J (2001) Traffic signal control using fuzzy logic and MOGA. In: IEEE international conference on systems, man, and cybernetics, pp 1335-1340
[36] Wen Y, Wu T (2005) Reduced-order rolling horizon optimization of traffic control based on ant algorithm. J Zhejiang Univ (Med Sci) 39(6):835-839
[37] Wiering M, Veenen J, Vreeken J, Koopman A (2004) Intelligent traffic light control. Technical Report UU-CS-2004
[38] Yao C, Cassandras CG (2011) Resource contention games in multiclass stochastic flow models. Nonlinear Analy Hybrid Syst 5(2):301-319 · Zbl 1225.93106 · doi:10.1016/j.nahs.2010.05.006
[39] Yu X, Recker W (2006) Stochastic adaptive control model for traffic signal systems. Transp Res Part C Emerg Technol 14(4):263-282 · doi:10.1016/j.trc.2006.08.002
[40] Zhao X, Chen Y (2003) Traffic light control method for a single intersection based on hybrid systems. In: Proceedings of the IEEE intelligent transp. systems, pp 1105-1109
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.