Controlling agents over long time scales using temporal value transport

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11769049
APP PUB NO 20210081723A1
SERIAL NO

17035546

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network system used to control an agent interacting with an environment to perform a specified task. One of the methods includes causing the agent to perform a task episode in which the agent attempts to perform the specified task; for each of one or more particular time steps in the sequence: generating a modified reward for the particular time step from (i) the actual reward at the time step and (ii) value predictions at one or more time steps that are more than a threshold number of time steps after the particular time step in the sequence; and training, through reinforcement learning, the neural network system using at least the modified rewards for the particular time steps.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • DEEPMIND TECHNOLOGIES LIMITED

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Abramson, Joshua Simon London, GB 3 4
Hung, Chia-Chun London, GB 44 111
Lillicrap, Timothy Paul London, GB 23 115
Wayne, Gregory Duncan London, GB 17 72

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Mar 26, 2027
7.5 Year Payment $3600.00 $1800.00 $900.00 Mar 26, 2031
11.5 Year Payment $7400.00 $3700.00 $1850.00 Mar 26, 2035
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00