DyETC: Dynamic Electronic Toll Collection for Traffic Congestion Alleviation

Haipeng Chen, Bo An, Guni Sharon, Josiah Hanna, Peter Stone, Chunyan Miao, Yeng Soh

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract / Description of output

To alleviate traffic congestion in urban areas, electronic toll collection (ETC) systems are deployed all over the world. Despite the merits, tolls are usually pre-determined and fixed from day to day, which fail to consider traffic dynamics and thus have limited regulation effect when traffic conditions are abnormal. In this paper, we propose a novel dynamic ETC (DyETC) scheme which adjusts tolls to traffic conditions in realtime. The DyETC problem is formulated as a Markov decision process (MDP), the solution of which is very challenging due to its 1) multi-dimensional state space, 2) multi-dimensional, continuous and bounded action space, and 3) time-dependent state and action values. Due to the complexity of the formulated MDP, existing methods cannot be applied to our problem. Therefore, we develop a novel algorithm, PG-beta, which makes three improvements to traditional policy gradient method by proposing 1) time-dependent value and policy functions, 2) Beta distribution policy function and 3) state abstraction. Experimental results show that, compared with existing ETC schemes, DyETC increases traffic volume by around 8%, and reduces travel time by around 14:6% during rush hour. Considering the total traffic volume in a traffic network, this contributes to a substantial increase to social welfare.
Original languageEnglish
Title of host publicationProceedings of the Thirty-Second AAAI Conferenceon Artificial Intelligence (AAAI-18)
Place of PublicationPalo Alto, California USA
PublisherAAAI Press
Pages757-765
Number of pages9
ISBN (Print)978-1-57735-800-8
Publication statusPublished - 25 Apr 2018
EventThirty-Second AAAI Conference on Artificial Intelligence - Hilton New Orleans Riverside, New Orleans, United States
Duration: 2 Feb 20187 Feb 2018
https://aaai.org/Conferences/AAAI-18/
https://aaai.org/Conferences/AAAI-18/

Publication series

NameProceedings of the AAAI Conference on Artificial Intelligence
PublisherAAAI Press
Number1
Volume32
ISSN (Print)2159-5399
ISSN (Electronic)2374-3468

Conference

ConferenceThirty-Second AAAI Conference on Artificial Intelligence
Abbreviated titleAAAI 2018
Country/TerritoryUnited States
CityNew Orleans
Period2/02/187/02/18
Internet address

Keywords / Materials (for Non-textual outputs)

  • Dynamic road pricing
  • Sequential planning
  • Policy gradient

Fingerprint

Dive into the research topics of 'DyETC: Dynamic Electronic Toll Collection for Traffic Congestion Alleviation'. Together they form a unique fingerprint.

Cite this