Adjustment of a learning rate of Q-learning used to control traffic signals

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 10242568
APP PUB NO 20180261085A1
SERIAL NO

15641434

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Technologies are described to adjust a learning rate of Q-learning being used to control traffic signals at an intersection. In some examples, a method may include generating control actions for traffic signals at an intersection based on Q-learning, determining a frequency of change in traffic pattern of the intersection, and adjusting a learning rate of the Q-learning based on the determined frequency of change in traffic pattern of the intersection. The Q-learning may determine the generated control actions based on at least a portion of historical traffic data of the intersection, and the change in traffic pattern may be a change from a first traffic pattern of the intersection to a second traffic pattern of the intersection.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
FUJITSU LIMITEDKAWASAKI-SHI KANAGAWA 211-8588

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Chen, Wei-Peng Fremont, US 169 3410
Liu, Lei San Jose, US 843 4906
Liu, Ying San Jose, US 647 4068

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
7.5 Year Payment $3600.00 $1800.00 $900.00 Sep 26, 2026
11.5 Year Payment $7400.00 $3700.00 $1850.00 Sep 26, 2030
Fee Large entity fee small entity fee micro entity fee
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00