Generating representations of speech signals using self-supervised learning

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 11551668
SERIAL NO

17138362

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

In one embodiment, a method includes generating audio segments from a speech signal, generating latent representations that respectively correspond to the audio segments, the latent representations comprising a first subset and a second subset, generating quantized representations that respectively correspond to the latent representations, masking the second subset of the latent representations, using a machine-learning model to process the first subset of the latent representations and the masked second subset of the latent representations to generate contextualized representations that respectively correspond to the latent representations, pre-training the machine-learning model based on comparisons between (1) a subset of the contextualized representations that respectively correspond to the masked second subset of the latent representations and (2) a subset of the quantized representations that respectively correspond to the masked second subset of the latent representations, and training the pre-trained machine-learning model to perform a speech analysis task.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

  • META PLATFORMS, INC.

International Classification(s)

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Auli, Michael Portola Valley, US 6 92
Baevski, Alexei Redwood City, US 1 1
Collobert, Ronan Stéfan Mountain View, US 6 73
Conneau, Alexis Foster City, US 1 1
Mohamed, Abdelrahman Redmond, US 2 72
Zhou, Yuhao Menlo Park, US 8 6

Cited Art Landscape

Load Citation

Patent Citation Ranking

Forward Cite Landscape

Load Citation

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Jul 10, 2026
7.5 Year Payment $3600.00 $1800.00 $900.00 Jul 10, 2030
11.5 Year Payment $7400.00 $3700.00 $1850.00 Jul 10, 2034
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00