SYSTEM AND METHOD FOR THROTTLING SERVICE REQUESTS HAVING NON-UNIFORM WORKLOADS

Number of patents in Portfolio can not be more than 2000

United States of America Patent

SERIAL NO

14570900

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

A system that provides services to clients may receive and service requests, various ones of which may require different amounts of work. The system may determine whether it is operating in an overloaded or underloaded state based on a current work throughput rate, a target work throughput rate, a maximum request rate, or an actual request rate, and may dynamically adjust the maximum request rate in response. For example, if the maximum request rate is being exceeded, the maximum request rate may be raised or lowered, dependent on the current work throughput rate. If the target or committed work throughput rate is being exceeded, but the maximum request rate is not being exceeded, a lower maximum request rate may be proposed. Adjustments to the maximum request rate may be made using multiple incremental adjustments. Service request tokens may be added to a leaky token bucket at the maximum request rate.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddressTotal Patents
AMAZON TECHNOLOGIES, INC.RENO, NV7679

International Classification(s)

  • [Classification Symbol]
  • [Patents Count]

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
FILIPE, MIGUEL MASCARENHAS SEATTLE, US 15 67
LUTZ, DAVID ALAN RENTON, US 23 59
MACCANTI, MAXIMILIANO BELLEVUE, US 17 136
RATH, TIMOTHY ANDREW DES MOINES, US 68 320
XIAO, WEI KIRKLAND, US 141 733
YANACEK, DAVID CRAIG SEATTLE, US 18 20

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation