Large-vocabulary speech recognition using an integrated syntactic and semantic statistical language model

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 5839106
SERIAL NO

08768122

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Methods and apparatus for performing large-vocabulary speech recognition employing an integrated syntactic and semantic statistical language model. In an exemplary embodiment, a stochastic language model is developed using a hybrid paradigm in which latent semantic analysis is combined with, and subordinated to, a conventional n-gram paradigm. The hybrid paradigm provides an estimate of the likelihood that a particular word, chosen from an underlying vocabulary will occur given a prevailing contextual history. The estimate is computed as a conditional probability that a word will occur given an 'integrated' history combining an n-word, syntactic-type history with a semantic-type history based on a much larger contextual framework. Thus, the exemplary embodiment seamlessly blends local language structures with global usage patterns to provide, in a single language model, the proficiency of a short-horizon, syntactic model with the large-span effectiveness of semantic analysis.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddressTotal Patents
APPLE INC.CUPERTINO, CA19560

International Classification(s)

  • [Classification Symbol]
  • [Patents Count]

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Bellegarda, Jerome R Los Gatos, CA 87 3421

Cited Art Landscape

Patent Info (Count) # Cites Year
 
APPLE INC. (1)
* 5384892 Dynamic language model for speech recognition 395 1992
 
CISCO TECHNOLOGY, INC. (1)
* 5502774 Automatic recognition of a consistent message using multiple complimentary sources of information 186 1994
* Cited By Examiner

Patent Citation Ranking

Forward Cite Landscape

Patent Info (Count) # Cites Year
 
Other [Check patent profile for assignment information] (16)
* 6601055 Explanation generation system for a diagnosis support tool employing an inference system 71 1999
10002189 Method and apparatus for searching using an active ontology 0 2008
9959870 Speech recognition involving a mobile device 0 2009
9946706 Automatic language identification for dynamic text processing 0 2013
9977779 Automatic supplementation of word correction dictionaries 0 2014
9966068 Interpreting and acting upon commands that involve sharing information with remote devices 0 2014
9966065 Multi-command single utterance input method 0 2015
* 9990361 Language independent representations 0 2015
9953088 Crowd sourcing information to fulfill user requests 0 2016
9972304 Privacy preserving distributed evaluation framework for embedded personalized systems 0 2016
9934775 Unit-selection text-to-speech synthesis based on predicted concatenation parameters 0 2016
9971774 Voice-based media searching 0 2016
9966060 System and method for user-specified pronunciation of words for speech synthesis and recognition 0 2017
9958987 Automated response to and sensing of user activity in portable devices 0 2017
9986419 Social reminders 0 2017
9965465 Distributed server system for language understanding 0 2017
 
Ramp, Inc. (1)
8280719 Methods and systems relating to information extraction 4 2006
 
NUANCE COMMUNICATIONS, INC. (71)
* 6167377 Speech recognition language models 144 1997
* 6044337 Selection of superwords based on criteria relevant to both speech recognition and understanding 83 1997
* 6021384 Automatic generation of superwords 129 1997
* 6052657 Text segmentation and identification of topic using language models 109 1997
* 6317707 Automatic clustering of tokens from a corpus for grammar acquisition 144 1998
* 6415248 Method for building linguistic models from a corpus 26 1999
7085720 Method for task classification using morphemes 25 2000
7158935 Method and system for predicting problematic situations in a automated dialog 27 2000
6941266 Method and system for predicting problematic dialog situations in a task classification system 76 2000
7003459 Method and system for predicting understanding errors in automated dialog systems 27 2001
6751591 Method and system for predicting understanding errors in a task classification system 98 2001
6751595 Multi-stage large vocabulary speech recognition system and method 70 2001
* 6751584 Automatic clustering of tokens from a corpus for grammar acquisition 20 2001
8392188 Method and system for building a phonotactic model for domain independent speech recognition 3 2001
* 6996519 Method and apparatus for performing relational speech recognition 8 2001
7286984 Method and system for automatically detecting morphemes in a task classification system using lattices 16 2002
* 2003/0191,625 Method and system for creating a named entity language model 112 2003
7725307 Query engine for processing voice based queries including semantic decoding 195 2003
7356462 Automatic clustering of tokens from a corpus for grammar acquisition 2 2003
9076448 Distributed real time speech recognition system 7 2003
7139698 System and method for generating morphemes 4 2003
7555431 Method for processing speech using dynamic grammars 191 2004
* 2004/0236,580 Method for processing speech using dynamic grammars 35 2004
7127395 Method and system for predicting understanding errors in a task classification system 38 2004
* 8036893 Method and system for identifying and correcting accent-induced speech recognition difficulties 37 2004
* 7640159 System and method of speech recognition for non-native speakers of a language 9 2004
* 2006/0020,462 System and method of speech recognition for non-native speakers of a language 13 2004
* 2006/0020,463 Method and system for identifying and correcting accent-induced speech recognition difficulties 14 2004
7308404 Method and apparatus for speech recognition using a dynamic vocabulary 76 2004
* 2005/0055,210 Method and apparatus for speech recognition using a dynamic vocabulary 38 2004
7729904 Partial speech processing device and method for use in distributed systems 174 2004
7702508 System and method for natural language processing of query answers 170 2004
7657424 System and method for processing sentence based queries 203 2004
7624007 System and method for natural language processing of sentence based queries 161 2004
7533020 Method and apparatus for performing relational speech recognition 7 2005
* 2005/0234,723 Method and apparatus for performing relational speech recognition 25 2005
8433558 Methods and systems for natural language understanding using human knowledge and collected data 2 2005
7529667 Automated dialog system and method 6 2005
7472060 Automated dialog system and method 58 2005
7440893 Automated dialog method with first and second thresholds for adapted dialog strategy 7 2005
7487088 Method and system for predicting understanding errors in a task classification system 55 2006
7440897 Method and system for automatically detecting morphemes in a task classification system using lattices 8 2006
7831426 Network based interactive speech recognition system 198 2006
7647225 Adjustable resource based speech recognition system 163 2006
* 2007/0094,032 ADJUSTABLE RESOURCE BASED SPEECH RECOGNITION SYSTEM 3 2006
7957970 Method and system for predicting problematic situations in automated dialog 3 2006
8352277 Method of interacting through speech with a web-connected server 17 2007
7725320 Internet based speech recognition system with dynamic grammars 161 2007
7698131 Speech recognition system for client devices having differing computing capabilities 153 2007
7620548 Method and system for automatic detecting morphemes in a task classification system using lattices 6 2007
* 2008/0177,544 METHOD AND SYSTEM FOR AUTOMATIC DETECTING MORPHEMES IN A TASK CLASSIFICATION SYSTEM USING LATTICES 1 2007
8762152 Speech recognition system interactive agent 15 2007
9190063 Multi-language speech recognition system 1 2007
7912702 Statistical language model trained with semantic variants 150 2007
7873519 Natural language speech lattice containing semantic variants 191 2007
* 2008/0052,063 Multi-language speech recognition system 132 2007
* 2008/0052,077 Multi-language speech recognition system 72 2007
7966174 Automatic clustering of tokens from a corpus for grammar acquisition 0 2008
7672841 Method for processing speech data for a distributed recognition system 147 2008
8229734 Semantic decoding of user queries 13 2008
7725321 Speech based query system using semantic decoding 148 2008
8010361 Method and system for automatically detecting morphemes in a task classification system using lattices 6 2008
* 2008/0288,244 METHOD AND SYSTEM FOR AUTOMATICALLY DETECTING MORPHEMES IN A TASK CLASSIFICATION SYSTEM USING LATTICES 1 2008
8200491 Method and system for automatically detecting morphemes in a task classification system using lattices 6 2011
8285546 Method and system for identifying and correcting accent-induced speech recognition difficulties 60 2011
8612212 Method and system for automatically detecting morphemes in a task classification system using lattices 3 2013
8798990 Methods and systems for natural language understanding using human knowledge and collected data 1 2013
8909529 Method and system for automatically detecting morphemes in a task classification system using lattices 0 2013
* 9412370 Method and system for dynamic creation of contexts 0 2014
9792904 Methods and systems for natural language understanding using human knowledge and collected data 1 2014
9514126 Method and system for automatically detecting morphemes in a task classification system using lattices 0 2014
 
CXENSE ASA (2)
* 6609087 Fact recognition system 48 1999
* 2006/0253,274 Methods and systems relating to information extraction 20 2006
 
PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA (2)
* 6182039 Method and apparatus using probabilistic language model based on confusable sets for speech recognition 80 1998
* 6233561 Method for goal-oriented speech translation in hand-held devices using meaning extraction and dialogue 94 1999
 
INTELLIGENT AUTOMATION, INC. (2)
7062220 Automated, computer-based reading tutoring systems and methods 22 2001
* 2002/0156,632 Automated, computer-based reading tutoring systems and methods 18 2001
 
NEWVALUEXCHANGE LTD (4)
8977584 Apparatuses, methods and systems for a digital conversation management platform 0 2011
9431028 Apparatuses, methods and systems for a digital conversation management platform 0 2014
9424861 Apparatuses, methods and systems for a digital conversation management platform 0 2014
9424862 Apparatuses, methods and systems for a digital conversation management platform 0 2014
 
MULTIMODAL TECHNOLOGIES, LLC (6)
7584103 Automated extraction of semantic content and generation of a structured document from speech 22 2004
* 2006/0041,428 Automated extraction of semantic content and generation of a structured document from speech 57 2004
8560314 Applying service levels to transcripts 0 2007
* 2007/0299,665 Automatic Decision Support 11 2007
8321199 Verification of extracted data 0 2010
* 2010/0211,869 Verification of Extracted Data 2 2010
 
NEC CORPORATION (1)
* 2015/0278,194 INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND MEDIUM 1 2013
 
APPLE INC. (106)
6374217 Fast update implementation for efficient latent semantic language modeling 84 1999
6477488 Method for dynamic context scope selection in hybrid n-gram+LSA language modeling 122 2000
6697779 Combined dual spectral and temporal alignment method for user authentication by voice 13 2000
* 6778952 Method for dynamic context scope selection in hybrid N-gram+LSA language modeling 122 2002
* 7191118 Method for dynamic context scope selection in hybrid N-gram+LSA language modeling 58 2004
* 2005/0015,239 Method for dynamic context scope selection in hybrid N-gramlanguage modeling 2 2004
8677377 Method and apparatus for building an intelligent automated assistant 80 2006
* 7720673 Method for dynamic context scope selection in hybrid N-GRAM+LSA language modeling 0 2007
* 2007/0162,276 Method for dynamic context scope selection in hybrid N-GRAMlanguage modeling 0 2007
8977255 Method and system for operating a multi-function portable electronic device using voice-activation 7 2007
8645137 Fast, language-independent method for user authentication by voice 61 2007
9053089 Part-of-speech tagging using latent analogy 1 2007
8620662 Context-aware unit selection 21 2007
9330720 Methods and apparatus for altering audio output signals 0 2008
8996376 Intelligent text-to-speech conversion 8 2008
8768702 Multi-tiered voice feedback in an electronic device 32 2008
8898568 Audio user interface 41 2008
8712776 Systems and methods for selective text to speech synthesis 13 2008
8583418 Systems and methods of detecting language and natural language strings for text to speech synthesis 7 2008
8676904 Electronic devices with voice command and contextual data processing capabilities 30 2008
8862252 Audio user interface for displayless electronic device 7 2009
9431006 Methods and apparatuses for automatic speech recognition 1 2009
8614431 Automated response to and sensing of user activity in portable devices 26 2009
8682649 Sentiment prediction from textual data 14 2009
8600743 Noise profile determination for voice-related feature 9 2010
8682667 User profiling for selecting user specific voice input processing information 64 2010
8713021 Unsupervised document clustering using latent semantic density analysis 8 2010
8719006 Combined statistical and rule-based part-of-speech tagging for text-to-speech synthesis 40 2010
8719014 Electronic device with text error correction based on voice recognition data 39 2010
9318108 Intelligent automated assistant 32 2011
8781836 Hearing assistance system for providing consistent human speech 2 2011
9262612 Device access using voice authentication 20 2011
8812294 Translating phrases from one language into another using an order-based set of declarative rules 1 2011
8706472 Method for disambiguating multiple readings in language conversion 48 2011
8762156 Speech recognition repair using contextual information 42 2011
9858925 Using context information to facilitate processing of commands in a virtual assistant 0 2011
8688446 Providing text input using speech data and non-speech data 71 2011
9483461 Handling speech synthesis of content for multiple languages 2 2012
8775442 Semantic search using a single-source semantic model 34 2012
9721563 Name recognition system 0 2012
9548050 Intelligent automated assistant 14 2012
8762469 Electronic devices with voice command and contextual data processing capabilities 20 2012
8713119 Electronic devices with voice command and contextual data processing capabilities 26 2012
8670985 Devices and methods for identifying a prompt corresponding to a voice input in a sequence of prompts 5 2012
8935167 Exemplar-based latent perceptual modeling for automatic speech recognition 2 2012
9547647 Voice-based media searching 8 2012
9117447 Using event alert text as input to an automated assistant 28 2012
8942986 Determining user intent based on ontologies of domains 24 2012
8903716 Personalized vocabulary for digital assistant 25 2012
8892446 Service orchestration for intelligent automated assistant 29 2012
8799000 Disambiguation based on active input elicitation by intelligent automated assistant 14 2012
8706503 Intent deduction based on previous user interactions with voice assistant 46 2012
8670979 Active input elicitation by intelligent automated assistant 48 2012
8660849 Prioritizing selection criteria by automated assistant 85 2012
8718047 Text to speech conversion of text messages from mobile communication devices 3 2012
9311043 Adaptive audio feedback system and method 2 2013
8751238 Systems and methods for determining the language to use for speech generated by a text to speech engine 6 2013
8930191 Paraphrasing of user requests and results by automated digital assistant 48 2013
8731942 Maintaining context information between user interactions with a voice assistant 26 2013
9495129 Device, method, and user interface for voice-activated navigation and browsing of a document 3 2013
9280610 Crowd sourcing information to fulfill user requests 35 2013
9075783 Electronic device with text error correction based on voice recognition data 2 2013
9576574 Context-sensitive handling of interruptions by intelligent digital assistant 3 2013
9361886 Providing text input using speech data and non-speech data 0 2013
9389729 Automated response to and sensing of user activity in portable devices 3 2013
9691383 Multi-tiered voice feedback in an electronic device 0 2013
9501741 Method and apparatus for building an intelligent automated assistant 4 2013
9412392 Electronic devices with voice command and contextual data processing capabilities 8 2014
9733821 Voice control to diagnose inadvertent activation of accessibility features 0 2014
9190062 User profiling for voice input processing 8 2014
9368114 Context-sensitive handling of interruptions 2 2014
9922642 Training an at least partial voice command system 0 2014
9697822 System and method for updating an adaptive speech recognition model 3 2014
9633674 System and method for detecting errors in interactions with a voice-based digital assistant 6 2014
9620104 System and method for user-specified pronunciation of words for speech synthesis and recognition 0 2014
9582608 Unified ranking with entropy-weighted information for phrase-based semantic auto-completion 2 2014
9300784 System and method for emergency calls initiated by voice command 7 2014
9734193 Determining domain salience ranking from ambiguous words in natural speech 1 2014
9502031 Method for supporting dynamic grammars in WFST-based ASR 2 2014
9338493 Intelligent automated assistant for TV user interactions 16 2014
9633004 Better resolution when referencing to concepts 0 2014
9620105 Analyzing audio input for efficient speech and music recognition 0 2014
9715875 Reducing the need for manual start/end-pointing and trigger phrases 0 2014
9430463 Exemplar-based natural language processing 1 2014
9711141 Disambiguating heteronyms in speech synthesis 1 2014
9798393 Text correction processing 0 2015
9760559 Predictive text input 0 2015
9785630 Text prediction using combined word N-gram and unigram language models 0 2015
9535906 Mobile device having human language translation capability with positional feedback 4 2015
9668121 Social reminders 0 2015
9646609 Caching apparatus for serving phonetic pronunciations 0 2015
9842105 Parsimonious continuous-space phrase representations for natural language processing 0 2015
9886432 Parsimonious handling of word inflection via categorical stem + suffix N-gram language models 0 2015
9865280 Structured dictation using intelligent automated assistants 0 2015
9842101 Predictive conversion of language input 0 2015
9818400 Method and apparatus for discovering trending terms in speech requests 0 2015
9899019 Systems and methods for structured stem and suffix language models 0 2015
9886953 Virtual assistant activation 0 2015
9721566 Competing devices responding to voice triggers 0 2015
9633660 User profiling for voice input processing 14 2015
9697820 Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks 0 2015
9646614 Fast, language-independent method for user authentication by voice 5 2015
9668024 Intelligent automated assistant for TV user interactions 0 2016
9626955 Intelligent text-to-speech conversion 1 2016
9619079 Automated response to and sensing of user activity in portable devices 1 2016
9865248 Intelligent text-to-speech conversion 0 2017
 
INTERACTIONS LLC (2)
* 7149687 Method of active learning for automatic speech recognition 34 2002
8990084 Method of active learning for automatic speech recognition 0 2014
 
RESOLVITY, INC. (1)
* 8682660 Method and system for post-processing speech recognition results 0 2009
 
MICROSOFT TECHNOLOGY LICENSING, LLC (5)
* 7844449 Scalable probabilistic latent semantic analysis 2 2006
* 2007/0239,431 Scalable probabilistic latent semantic analysis 1 2006
* 2009/0326,924 Projecting Semantic Information from a Language Independent Syntactic Model 4 2008
* 2009/0326,925 PROJECTING SYNTACTIC INFORMATION USING A BOTTOM-UP PATTERN MATCHING ALGORITHM 32 2008
9715498 Distributed server system for language understanding 1 2015
 
KONINKLIJKE PHILIPS ELECTRONICS N.V. (2)
* 7424428 Automatic dialog system with database language model 14 2002
* 2004/0034,518 Automatic dialog system with database language model 5 2002
 
XYLON LLC (3)
6904405 Message recognition using shared language model 108 2002
* 8204737 Message recognition using shared language model 5 2005
* 2005/0171,783 Message recognition using shared language model 30 2005
 
LENOVO (SINGAPORE) PTE. LTD. (1)
* 9620122 Hybrid speech recognition 2 2011
 
THE TRUSTEES OF THE STEVENS INSTITUTE OF TECHNOLOGY (1)
* 2012/0254,333 AUTOMATED DETECTION OF DECEPTION IN SHORT AND MULTILINGUAL ELECTRONIC MESSAGES 85 2012
 
RAYTHEON BBN TECHNOLOGIES CORP. (8)
7401023 Systems and methods for providing automated directory assistance using transcripts 18 2000
7447636 System and methods for using transcripts to train an automated directory assistance service 17 2005
7890539 Semantic matching using predicate-argument structure 18 2007
* 2009/0100,053 Semantic matching using predicate-argument structure 6 2007
8131536 Extraction-empowered machine translation 9 2007
* 2008/0215,309 Extraction-Empowered machine translation 11 2007
8595222 Methods and systems for representing, using and displaying time-varying information on the semantic web 7 2008
8260817 Semantic matching using predicate-argument structure 9 2011
 
UBS AG (1)
* 7236931 Systems and methods for automatic acoustic speaker adaptation in computer-assisted transcription systems 37 2003
 
INTERNATIONAL BUSINESS MACHINES CORPORATION (6)
* 6577999 Method and apparatus for intelligently managing multiple pronunciations for a speech recognition vocabulary 8 1999
* 6385579 Methods and apparatus for forming compound words for use in a continuous speech recognition system 28 1999
* 6529902 Method and system for off-line detection of textual topical changes and topic identification via likelihood based methods for improved language modeling 51 1999
* 7644057 System and method for electronic communication management 17 2004
* 7752159 System and method for classifying text 19 2007
* 2007/0294,199 SYSTEM AND METHOD FOR CLASSIFYING TEXT 39 2007
 
SOPHIA SEARCH LIMITED (2)
* 7747593 Computer aided document retrieval 19 2004
* 2007/0174,267 Computer aided document retrieval 21 2004
 
BBN TECHNOLOGIES CORP. (1)
* 2004/0243,531 Methods and systems for representing, using and displaying time-varying information on the Semantic Web 42 2004
 
ECOLLEGE.COM (2)
6871043 Variable types of sensory interaction for an on-line educational system 12 2002
6965752 On-line educational system having an electronic notebook feature 10 2003
 
SIEMENS AKTIENGESELLSCHAFT (1)
* 6640207 Method and configuration for forming classes for a language model based on linguistic classes 13 2001
 
PRYSM, INC. (1)
* 9864741 Automated collective term and phrase index 0 2015
 
MMODAL IP LLC (2)
8959102 Structured searching of dynamic structured document corpuses 2 2011
9892734 Automatic decision support 0 2013
 
APTIMA, INC. (2)
9165254 Method and system to predict the likelihood of topics 0 2009
* 2010/0280,985 METHOD AND SYSTEM TO PREDICT THE LIKELIHOOD OF TOPICS 45 2009
 
THOMSON LICENSING (1)
* 2003/0105,632 Syntactic and semantic analysis of voice commands 8 2002
 
GOOGLE LLC (1)
* 9324323 Speech recognition using topic-specific language models 15 2012
 
SCANSOFT, INC. (1)
* 2004/0088,162 Systems and methods for automatic acoustic speaker adaptation in computer-assisted transcription systems 35 2003
 
INTEL CORPORATION (4)
* 7346495 Method and system for building a domain specific statistical language model from rule based grammar specifications 6 2000
* 7275033 Method and system for using rule-based knowledge to build a class-based domain specific statistical language model 18 2000
* 9323854 Method, apparatus and system for location assisted translation 0 2008
* 2010/0161,311 Method, apparatus and system for location assisted translation 11 2008
 
NIPPON TELEGRAPH AND TELEPHONE CORPORATION (3)
* 6173261 Grammar fragment acquisition using syntactic and semantic clustering 260 1998
* 8666744 Grammar fragment acquisition using syntactic and semantic clustering 1 2000
9330660 Grammar fragment acquisition using syntactic and semantic clustering 0 2014
* Cited By Examiner