Approximate value iteration with complex returns by bounding

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 10839302
APP PUB NO 20180012137A1
SERIAL NO

15359122

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A control system and method for controlling a system, which employs a data set representing a plurality of states and associated trajectories of an environment of the system; and which iteratively determines an estimate of an optimal control policy for the system. The iterative process performs the substeps, until convergence, of estimating a long term value for operation at a respective state of the environment over a series of predicted future environmental states; using a complex return of the data set to determine a bound to improve the estimated long term value; and producing an updated estimate of an optimal control policy dependent on the improved estimate of the long term value. The control system may produce an output signal to control the system directly, or output the optimized control policy. The system preferably is a reinforcement learning system which continually improves.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • THE RESEARCH FOUNDATION FOR THE STATE UNIVERSITY OF NEW YORK

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Loscalzo, Steven Vienna, US 2 49
Wright, Robert Sherrill, US 66 874
Yu, Lei Vestal, US 262 2212

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 May 17, 2024
7.5 Year Payment $3600.00 $1800.00 $900.00 May 17, 2028
11.5 Year Payment $7400.00 $3700.00 $1850.00 May 17, 2032
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00