Utilizing relevant offline models to warm start an online bandit learner model

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11669768
APP PUB NO 20210097350A1
SERIAL NO

16584082

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Methods, systems, and non-transitory computer readable storage media are disclosed for utilizing offline models to warm start online bandit learner models. For example, the disclosed system can determine relevant offline models for an environment based on reward estimate differences between the offline models and the online model. The disclosed system can then utilize the relevant offline models (if any) to select an arm for the environment. The disclosed system can update the online model based on observed rewards for the selected arm. Additionally, the disclosed system can also use entropy reduction of arms to determine the utility of the arms in differentiating relevant and irrelevant offline models. For example, the disclosed system can select an arm based on a combination of the entropy reduction of the arm and the reward estimate for the arm and use the observed reward to update an observation history.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • ADOBE INC.

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Theocharous, Georgios San Jose, US 39 145
Wen, Zheng Fremont, US 17 46
Wu, Qingyun Charlottsville, US 5 27
Yadkori, Yasin Abbasi Hanoi, VN 8 15

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Dec 6, 2026
7.5 Year Payment $3600.00 $1800.00 $900.00 Dec 6, 2030
11.5 Year Payment $7400.00 $3700.00 $1850.00 Dec 6, 2034
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00