Systems and methods for training a reinforcement learning system for pallet routing in a manufacturing environment

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11860592
APP PUB NO 20230195057A1
SERIAL NO

17558805

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A method includes obtaining state information from one or more sensors of a digital twin. The method includes determining an action at the first routing control location based on the state information, where the action includes one of a pallet merging operation and a pallet splitting operation, and determining a consequence state based on the action. The method includes calculating a transient production value based on the consequence state and a transient objective function, calculating a steady state production value based on the consequence state and a steady state objective function, and selectively adjusting one or more reinforcement parameters of the reinforcement learning system based on the transient production value and the steady state production value.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddress
FORD GLOBAL TECHNOLOGIES LLCONE AMERICAN ROAD FOURTH FLOOR DEARBORN MI 48126-2701

International Classification(s)

  • [Classification Symbol]
  • [Patents Count]

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Bennett, Robert Dearborn, US 600 81977
Birley, Jim Bingham Farms, US 3 0
Filev, Dimitar Petrov Novi, US 127 2832
Maske, Harshal Farmington Hills, US 4 3
Miller, Justin Berkley, US 100 468
Upadhyay, Devesh Canton, US 69 1067

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Jul 2, 2027
7.5 Year Payment $3600.00 $1800.00 $900.00 Jul 2, 2031
11.5 Year Payment $7400.00 $3700.00 $1850.00 Jul 2, 2035
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00