Method and system for adaptive cycle-level traffic signal control

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11783702
SERIAL NO

17327523

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Methods, systems, and processor-readable media for adaptive cycle-level traffic signal control are described. An adaptive cycle-level traffic signal controller and control method that operate within a continuous action space. A reinforcement learning algorithm called Proximal Policy Optimization (PPO), which is a type of actor-critic model for reinforcement learning, may be used to generate signal cycle phase durations selected from a continuous range of values. The controller thus does not treat the action space as discrete, but instead produces continuous values as output. The generated phase durations may define a full traffic signal cycle. The inputs to the controller may indicate current and past states of the traffic environment. The average duration of delay of vehicles in the traffic environment may be used to calculate the reward for the reinforcement learning model that drives the behavior of the controller.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • HUAWEI CLOUD COMPUTING TECHNOLOGIES CO., LTD.

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Abdulhai, Baher Mississauga, CA 4 26
Huo, Yi HangZhou, CN 1 0
Ma, Hao Hai Kleinburg, CA 6 63
Mohamad, Alizadeh Shabestary Soheil Toronto, CA 1 0

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Apr 10, 2027
7.5 Year Payment $3600.00 $1800.00 $900.00 Apr 10, 2031
11.5 Year Payment $7400.00 $3700.00 $1850.00 Apr 10, 2035
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00