Method and apparatus for embodied conversational characters with multimodal input/output in an interface device

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 6570555
SERIAL NO

09223637

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Deliberative and reactive processing are combined to process multi-modal inputs and direct movements and speech of a synthetic character that operates as an interface between a user and a piece of equipment. The synthetic character is constructed as an ally, working with and helping the user learn and operate the equipment. The synthetic character interacts with both a virtual space where the character is displayed, and a physical space (domain) that includes the user. Real-time reactive processing provides lifelike and engaging responses to user queries and conversations. Deliberative processing provides responses to inputs that require more processing time (deep linguistic processing, for example). Knowledge bases are maintained for both dynamic (discourse model, for example) and static (e.g., knowledge about the domain or discourse plans) information types. A rule based system is utilized against the knowledge bases and selected inputs from said user to determine input meanings, and follow a predetermined discourse plan.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddressTotal Patents
FUJI XEROX CO., LTD.TOKYO7694
XEROX CORPORATIONSTAMFORD, CT13415

International Classification(s)

  • [Classification Symbol]
  • [Patents Count]

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Bickmore, Timothy W Somerville, MA 8 1073
Churchill, Elizabeth San Francisco, CA 21 730
Girgensohn, Andreas Menlo Park, CA 57 2492
Prevost, Scott A San Francisco, CA 6 670
Sullivan, Joseph W San Francisco, CA 11 1193

Cited Art Landscape

Patent Info (Count) # Cites Year
 
MASSACHUSETTS INSTITUTE OF TECHNOLOGY (1)
5563988 Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment 498 1994
 
INTERNATIONAL BUSINESS MACHINES CORPORATION (2)
* 5157384 Advanced user interface 225 1989
* 5936624 Data processing system having a logical containment system and method therefor 20 1997
 
AVID TECHNOLOGY, INC. (1)
* 6084569 Editing interface 6 1997
 
SIERRA ENTERTAINMENT, INC. (1)
* 5111409 Authoring and use systems for sound synchronized animation 234 1989
 
U.S. PHILIPS CORPORATION (1)
* 6075515 Virtual workspace for tactual interaction 5 1998
 
AVAYA INC. (1)
* 6012030 Management of speech and audio prompts in multimodal interfaces 120 1998
 
TAIWAN SEMICONDUCTOR MANUFACTURING COMPANY, LTD. (1)
* 4965741 Method for providing an improved human user interface to a knowledge based system 76 1988
 
Aerospatiale Societe Nationale Industrielle (1)
* 6072473 Method and device for multimode and multifunction communication between an operator and one or more processors 53 1994
 
SINGAPORE COMPUTER SYSTEMS LIMITED (1)
* 5432887 Neural network system and method for factory floor scheduling 40 1993
 
UCHICAGO ARGONNE, LLC (1)
* 6058387 Dynamic information architecture system and method 26 1996
 
COMPASSLEARNING, INC. (1)
* 5310349 Instructional management system 329 1992
* Cited By Examiner

Patent Citation Ranking

Forward Cite Landscape

Patent Info (Count) # Cites Year
 
Other [Check patent profile for assignment information] (27)
* 7225233 System and method for interactive, multimedia entertainment, education or other experience, and revenue generation therefrom 9 2000
* 2001/0047,346 Artificial intelligence and computer interface 4 2001
7137861 Interactive three-dimensional multimedia I/O device for a computer 6 2003
* 2004/0103,222 INTERACTIVE THREE-DIMENSIONAL MULTIMEDIA I/O DEVICE FOR A COMPUTER 0 2003
* 2007/0174,235 Method of using digital characters to compile information 2 2006
* 2007/0260,695 System and method for interactive, multimedia entertainment, education or other experience, and revenue generation therefrom 6 2007
* 2008/0114,848 Overlaid Display of Messages in the User Interface of Instant Messaging and Other Digital Communication Services 6 2007
8714982 System and method for teaching social skills, social thinking, and social awareness 1 2008
* 2009/0097,757 SYSTEM AND METHOD FOR TEACHING SOCIAL SKILLS, SOCIAL THINKING, AND SOCIAL AWARENESS 3 2008
9940553 Camera/object pose from predicted coordinates 0 2013
9953213 Self discovery of autonomous NUI devices 0 2013
10027606 Method and apparatus for determining a notification representation indicative of a cognitive load 0 2013
9971491 Gesture library for natural user input 0 2014
10048763 Distance scalable no touch computing 0 2014
* 10096085 Method for generating images for multi-projection theater and image management apparatus using the same 0 2014
10085072 Systems and methods for automatically detecting users within detection regions of media devices 0 2015
10101803 Dynamic switching and merging of head, gesture and touch input in virtual reality 0 2015
9953426 Object digitization 0 2015
10049458 Reducing interference between multiple infra-red depth cameras 0 2016
9959459 Extraction of user behavior from depth images 0 2016
10024968 Optical modules that reduce speckle contrast and diffraction artifacts 0 2016
9958952 Recognition system for sharing information 0 2016
9953649 System and method for processing multi-modal device interactions in a natural language voice services environment 0 2017
9943755 Device for identifying and tracking multiple humans over time 0 2017
10089984 System and method for an integrated, multi-modal, multi-device natural language voice services environment 0 2017
10089454 Enhanced accuracy of user presence status determination 0 2017
* 10097921 Methods circuits devices systems and associated computer executable code for acquiring acoustic signals 0 2017
 
VOICEBOX TECHNOLOGIES CORPORATION (30)
8073681 System and method for a cooperative conversational voice user interface 209 2006
7818176 System and method for selecting and presenting advertisements based on natural language processing of voice-based input 212 2007
8140335 System and method for providing a natural language voice user interface in an integrated voice navigation services environment 189 2007
8589161 System and method for an integrated, multi-modal, multi-device natural language voice services environment 27 2008
8326637 System and method for processing multi-modal device interactions in a natural language voice services environment 40 2009
9171541 System and method for hybrid processing in a natural language voice services environment 17 2010
8145489 System and method for selecting and presenting advertisements based on natural language processing of voice-based input 42 2010
9502025 System and method for providing a natural language content dedication service 11 2010
8515765 System and method for a cooperative conversational voice user interface 30 2011
8452598 System and method for providing advertisements in an integrated voice navigation services environment 35 2011
8370147 System and method for providing a natural language voice user interface in an integrated voice navigation services environment 38 2011
8326627 System and method for dynamically generating a recognition grammar in an integrated voice navigation services environment 40 2011
8527274 System and method for delivering targeted advertisements and tracking advertisement interactions in voice recognition contexts 28 2012
8719009 System and method for processing multi-modal device interactions in a natural language voice services environment 27 2012
8983839 System and method for dynamically generating a recognition grammar in an integrated voice navigation services environment 14 2012
8738380 System and method for processing multi-modal device interactions in a natural language voice services environment 25 2012
8719026 System and method for providing a natural language voice user interface in an integrated voice navigation services environment 24 2013
9015049 System and method for a cooperative conversational voice user interface 14 2013
8886536 System and method for delivering targeted advertisements and tracking advertisement interactions in voice recognition contexts 15 2013
9305548 System and method for an integrated, multi-modal, multi-device natural language voice services environment 26 2013
9620113 System and method for providing a natural language voice user interface 2 2014
9105266 System and method for processing multi-modal device interactions in a natural language voice services environment 11 2014
9263039 Systems and methods for responding to natural language speech utterance 6 2014
9269097 System and method for delivering targeted advertisements and/or providing natural language processing based on advertisements 11 2014
9570070 System and method for processing multi-modal device interactions in a natural language voice services environment 1 2015
9406078 System and method for delivering targeted advertisements and/or providing natural language processing based on advertisements 8 2015
9898459 Integration of domain information into state transitions of a finite state transducer for natural language processing 0 2015
9626703 Voice commerce 0 2015
9747896 System and method for providing follow-up responses to prior natural language inputs of a user 0 2015
9711143 System and method for an integrated, multi-modal, multi-device natural language voice services environment 1 2016
 
SONY CORPORATION (4)
* 7426467 System and method for supporting interactive user interface operations and storage medium 189 2001
* 2002/0010,589 System and method for supporting interactive operations and storage medium 36 2001
* 7523084 Action evaluation apparatus and method 1 2006
* 2006/0293,900 Action evaluation apparatus and method 0 2006
 
THE INVENTION SCIENCE FUND I, LLC (4)
8626731 Component information and auxiliary information related to information management 2 2007
* 2008/0189,112 Component information and auxiliary information related to information management 7 2007
* 8055648 Managing information related to communication 0 2007
9158771 Component information and auxiliary information related to information management 0 2013
 
SAMSUNG ELECTRONICS CO., LTD. (3)
* 7734468 Method of and apparatus for managing dialog between user and agent 4 2003
* 2004/0122,673 Method of and apparatus for managing dialog between user and agent 32 2003
* 2010/0182,324 DISPLAY APPARATUS AND DISPLAY METHOD FOR PERFORMING ANIMATION OPERATIONS 4 2009
 
ORACLE AMERICA, INC. (1)
* 2004/0210,431 Method and apparatus for accelerated post-silicon testing and random number generation 1 2003
 
AT&T INTELLECTUAL PROPERTY I, L.P. (1)
* 8823793 System and method for performing security tasks 5 2008
 
ORACLE INTERNATIONAL CORPORATION (4)
* 7334183 Domain-specific concatenative audio 8 2003
* 2004/0138,887 Domain-specific concatenative audio 6 2003
* 7418434 Forward-chaining inferencing 13 2005
* 2005/0240,546 FORWARD-CHAINING INFERENCING 9 2005
 
INTELLIJAX CORPORATION (2)
* 9552739 Computer-based tutoring method and system 0 2009
* 2009/0298,039 Computer-Based Tutoring Method and System 6 2009
 
AVAYA INC. (13)
* 2004/0034,531 Distributed multimodal dialogue system and method 18 2002
8489442 Interface for meeting facilitation and coordination, method and apparatus 11 2004
7984378 Management of meetings by grouping 5 2006
8600794 Meeting notification and merging agents 0 2006
* 2007/0265,903 Meeting notification and merging agents 16 2006
7778858 Linking unable to respond messages to entries in electronic calendar 7 2006
8037143 Automatic display of email distribution lists 7 2006
7693736 Recurring meeting schedule wizard 27 2006
7827240 Calendar item hierarchy for automatic specialization 13 2007
8060565 Voice and text session converter 28 2007
8706539 Interface for meeting facilitation and coordination, method and apparatus 2 2009
8230034 Automatic display of email distribution lists 1 2011
* 2011/0225,254 AUTOMATIC DISPLAY OF EMAIL DISTRIBUTION LISTS 10 2011
 
KONINKLIJKE PHILIPS ELECTRONICS N.V. (1)
* 2003/0123,728 Interactive video installation and method thereof 2 2001
 
DISNEY ENTERPRISES, INC. (1)
* 9811937 Coordinated gesture and locomotion for virtual pedestrians 0 2015
 
Exbibuo B.V. (1)
7606741 Information gathering system and method 144 2005
 
LOCKHEED MARTIN CORPORATION (2)
* 8615383 Immersive collaborative environment using motion capture, head mounted display, and cave 6 2009
* 2009/0187,389 Immersive Collaborative Environment Using Motion Capture, Head Mounted Display, and Cave 48 2009
 
UNIVERSITY OF FLORIDA RESEARCH FOUNDATION, INC. (1)
* 2005/0255,434 Interactive virtual characters for training including medical diagnosis training 38 2005
 
RAKUTEN, INC. (3)
* 7373292 Text-to-scene conversion 5 2005
7962329 Text-to-scene conversion 0 2008
8086028 Text-to-scene conversion 1 2009
 
INTERNATIONAL BUSINESS MACHINES CORPORATION (8)
* 8719200 Cyberpersonalities in artificial reality 5 2007
* 2009/0254,417 HYDRATE-BASED DESALINATION USING COMPOUND PERMEABLE RESTRAINT PANELS AND VAPORIZATION-BASED COOLING 23 2007
* 8244776 Method and device for customizing a mail history 0 2008
* 2009/0144,339 METHOD AND DEVICE FOR CUSTOMIZING A MAIL HISTORY 0 2008
8645432 Method and device for customizing a mail history 0 2012
* 9369410 Chatbots 3 2014
* 9213940 Cyberpersonalities in artificial reality 0 2014
9794199 Chatbots 0 2016
 
SAP SE (2)
* 8594997 Context-aware conversational user interface 1 2010
* 2012/0078,611 CONTEXT-AWARE CONVERSATIONAL USER INTERFACE 15 2010
 
HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. (3)
7593854 Method and system for collecting user-interest information regarding a picture 4 2002
* 2003/0144,843 Method and system for collecting user-interest information regarding a picture 32 2002
* 2003/0112,267 Multi-modal picture 65 2002
 
LUCENT TECHNOLOGIES INC. (1)
* 2010/0074,460 SELF-STEERING DIRECTIONAL HEARING AID AND METHOD OF OPERATION THEREOF 17 2008
 
CISCO TECHNOLOGY, INC. (2)
* 9317953 Coordinated 2-dimensional and 3-dimensional graphics processing 1 2011
* 2013/0293,537 Coordinated 2-Dimensional and 3-Dimensional Graphics Processing 1 2011
 
Leviathan Entertainment, LLC (1)
* 2007/0087,819 Financial institutions and instruments in a virtual environment 64 2006
 
CJ CGV CO., LTD. (1)
* 2015/0163,447 METHOD FOR GENERATING IMAGES FOR MULTI-PROJECTION THEATER AND IMAGE MANAGEMENT APPARATUS USING THE SAME 0 2014
 
GOOGLE LLC (48)
7707039 Automatic modification of web pages 98 2004
9008447 Method and system for character recognition 0 2005
8515816 Aggregate analysis of text captures performed by multiple users from rendered documents 6 2005
8214387 Document enhancement system and method 25 2005
8019648 Search engines and systems with handheld document data capture devices 13 2005
7831912 Publishing techniques for adding value to a rendered document 68 2005
7742953 Adding information or functionality to a rendered document via association with an electronic counterpart 165 2005
7599580 Capturing text from rendered documents using supplemental information 103 2005
7599844 Content access with handheld document data capture devices 100 2005
7596269 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 110 2005
7593605 Data capture from rendered documents using handheld device 196 2005
7421155 Archive of text captures from rendered documents 156 2005
8713418 Adding value to a rendered document 35 2005
7702624 Processing techniques for visual capture data from a rendered document 51 2005
7818215 Processing techniques for text capture from a rendered document 166 2005
8005720 Applying scanned information to identify content 23 2005
7437023 Methods, systems and computer program products for data gathering in a digital and hard copy document environment 113 2005
7706611 Method and system for character recognition 55 2005
7812860 Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device 83 2005
7990556 Association of a portable scanner with input/output and storage devices 8 2006
8081849 Portable scanning and memory device 12 2007
8442331 Capturing text from rendered documents using supplemental information 6 2009
8489624 Processing techniques for text capture from a rendered document 4 2010
8638363 Automatically capturing information, such as capturing information using a document-aware device 7 2010
8418055 Identifying a document by performing spectral analysis on the contents of the document 31 2010
8990235 Automatically providing content associated with captured information, such as information captured in real-time 50 2010
8447066 Performing actions based on capturing information from rendered documents, such as documents under copyright 82 2010
8874504 Processing techniques for visual capture data from a rendered document 5 2010
8600196 Optical scanners, such as hand-held optical scanners 6 2010
8261094 Secure data gathering from rendered documents 2 2010
8346620 Automatic modification of web pages 17 2010
8179563 Portable scanning device 35 2010
9081799 Using gestalt information to identify locations in printed information 3 2010
9323784 Image search using text-based elements within the contents of images 3 2010
8620083 Method and system for character recognition 4 2011
8505090 Archive of text captures from rendered documents 3 2012
9268852 Search engines and systems with handheld document data capture devices 0 2012
8799099 Processing techniques for text capture from a rendered document 0 2012
8781228 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 2 2012
9275051 Automatic modification of web pages 0 2012
8831365 Capturing text from rendered documents using supplement information 1 2013
9075779 Performing actions based on capturing information from rendered documents, such as documents under copyright 1 2013
9143638 Data capture from rendered documents using handheld device 4 2013
8953886 Method and system for character recognition 8 2013
9030699 Association of a portable scanner with input/output and storage devices 0 2013
9116890 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 2 2014
9514134 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 0 2015
9633013 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 0 2016
 
MOTOROLA, INC. (1)
* 2005/0165,601 Method and apparatus for determining when a user has ceased inputting data 1 2004
 
FUJI XEROX CO., LTD. (4)
* 7809792 Conference information processing apparatus, and conference information processing method and storage medium readable by computer 3 2004
* 2005/0210,105 Conference information processing apparatus, and conference information processing method and storage medium readable by computer 18 2004
7783106 Video segmentation combining similarity analysis and classification 9 2004
* 2006/0107,216 Video segmentation combining similarity analysis and classification 11 2004
 
BRITISH TELECOMMUNICATIONS PUBLIC LIMITED COMPANY (2)
* 2005/0172,232 Synchronisation in multi-modal interfaces 17 2004
* 2007/0250,841 Multi-modal interface 53 2007
 
STARS 1-TO-1 (1)
* 2002/0010,584 Interactive voice communication method and system for information and entertainment 162 2001
 
MICE TECHNOLOGIES, INC. (1)
* 2006/0250,352 System and method for improved cursor functionality 5 2005
 
INTEL CORPORATION (3)
* 8977972 Using multi-modal input to control multiple objects on a display 1 2009
* 2011/0161,890 Using multi-modal input to control multiple objects on a display 40 2009
9600296 Executing a command within a transport mechanism based on a get and set architecture 0 2012
 
SOFFINO, LLC. (1)
* 2006/0041,848 Overlaid display of messages in the user interface of instant messaging and other digital communication services 48 2005
 
MICROSOFT CORPORATION (2)
8634636 Systems and methods for removing a background of an image 0 2009
8824780 Human tracking system 0 2013
 
MICROSOFT INTERNATIONAL HOLDINGS B.V. (2)
8681321 Gated 3D camera 2 2009
9641825 Gated 3D camera 0 2014
 
ROBERT D. LINDNER, JR. (2)
6865370 Learning method and system based on questioning 16 2003
* 2004/0110,120 Learning method and system based on questioning 10 2003
 
NUANCE COMMUNICATIONS, INC. (50)
* 7729918 Trainable sentence planning system 47 2002
* 7574362 Method for automated sentence planning in a task classification system 46 2002
* 7516076 Automated sentence planning in a task classification system 48 2002
* 2003/0110,037 Automated sentence planning in a task classification system 51 2002
* 2003/0097,249 Trainable sentence planning system 55 2002
7398209 Systems and methods for responding to natural language speech utterance 269 2003
7693720 Mobile systems and methods for responding to natural language speech utterance 438 2003
* 7117155 Coarticulation method for audio-visual text-to-speech synthesis 0 2003
* 2004/0064,321 Coarticulation method for audio-visual text-to-speech synthesis 3 2003
* 7617105 Converting text-to-speech and adjusting corpus 9 2005
* 2005/0267,758 Converting text-to-speech and adjusting corpus 8 2005
7640160 Systems and methods for responding to natural language speech utterance 235 2005
* 2007/0033,005 Systems and methods for responding to natural language speech utterance 113 2005
7620549 System and method of supporting adaptive misrecognition in conversational speech 227 2005
* 2007/0038,436 System and method of supporting adaptive misrecognition in conversational speech 211 2005
7949529 Mobile systems and methods of supporting natural language human-machine interactions 404 2005
* 2007/0050,191 Mobile systems and methods of supporting natural language human-machine interactions 255 2005
* 7392190 Coarticulation method for audio-visual text-to-speech synthesis 1 2006
7634409 Dynamic speech sharpening 210 2006
* 2007/0055,525 Dynamic speech sharpening 137 2006
7502738 Systems and methods for responding to natural language speech utterance 211 2007
* 2007/0265,850 SYSTEMS AND METHODS FOR RESPONDING TO NATURAL LANGUAGE SPEECH UTTERANCE 86 2007
8015006 Systems and methods for processing natural language speech utterances with context-specific domain agents 239 2008
7809570 Systems and methods for responding to natural language speech utterance 209 2008
* 2008/0319,751 SYSTEMS AND METHODS FOR RESPONDING TO NATURAL LANGUAGE SPEECH UTTERANCE 58 2008
8731929 Agent architecture for determining meanings of natural language utterances 26 2009
8019610 Automated sentence planning in a task classification system 43 2009
7949537 Method for automated sentence planning in a task classification system 45 2009
8332224 System and method of supporting adaptive misrecognition conversational speech 114 2009
8069046 Dynamic speech sharpening 196 2009
7983917 Dynamic speech sharpening 198 2009
7917367 Systems and methods for responding to natural language speech utterance 203 2009
9031845 Mobile systems and methods for responding to natural language speech utterance 3 2010
8140327 System and method for filtering and eliminating noise from natural language utterances to improve speech recognition and parsing 48 2010
8112275 System and method for user-specific speech recognition 198 2010
8185401 Automated sentence planning in a task classification system 0 2010
8155962 Method and system for asynchronously processing natural language utterances 49 2010
8326634 Systems and methods for responding to natural language speech utterance 60 2011
8620659 System and method of supporting adaptive misrecognition in conversational speech 93 2011
8195468 Mobile systems and methods of supporting natural language human-machine interactions 103 2011
8209186 Method for automated sentence planning in a task classification system 0 2011
* 2011/0218,807 Method for Automated Sentence Planning in a Task Classification System 0 2011
8150694 System and method for providing an acoustic grammar to dynamically sharpen speech interpretation 110 2011
8180647 Automated sentence planning in a task classification system 14 2011
8620669 Automated sentence planning in a task classification system 6 2012
8447607 Mobile systems and methods of supporting natural language human-machine interactions 190 2012
8849670 Systems and methods for responding to natural language speech utterance 28 2012
8849652 Mobile systems and methods of supporting natural language human-machine interactions 16 2013
9626959 System and method of supporting adaptive misrecognition in conversational speech 0 2013
9495957 Mobile systems and methods of supporting natural language human-machine interactions 1 2014
 
OMRON CORPORATION (2)
7944448 Apparatus and method for socially intelligent virtual entity 11 2005
* 2006/0248,461 Socially intelligent agent software 9 2006
 
INTERACTIVE BID GAMES, INC. (1)
* 2013/0304,599 METHOD AND SYSTEM OF CONDUCTING INTERACTIVE ONLINE AUCTIONS 0 2013
 
ZOESIS, INC. (4)
* 7478047 Interactive character system 86 2001
* 2004/0075,677 Interactive character system 124 2003
* 2008/0120,113 INTERACTIVE CHARACTER SYSTEM 20 2007
* 2011/0016,004 INTERACTIVE CHARACTER SYSTEM 24 2010
 
XEROX CORPORATION (1)
* 2003/0193,504 System for designing and rendering personalities for autonomous synthetic characters 11 2003
 
NOKIA TECHNOLOGIES OY (1)
9507481 Method and apparatus for determining an invocation input based on cognitive load 0 2013
 
LINDNER, JR., MR. ROBERT D. (2)
* 2002/0128,818 Method and system to answer a natural-language question 23 2002
* 2003/0224,341 LEARNING METHOD AND SYSTEM BASED ON QUESTIONING 1 2002
 
MASSACHUSETTS INSTITUTE OF TECHNOLOGY (2)
* 7642989 System for and method of motion and force synchronization with time delay reduction in multi-user shared virtual environments 20 2006
* 2006/0256,080 System for and method of motion and force synchronization with time delay reduction in multi-user shared virtual environments 1 2006
 
Kurzweil AINetworks, Inc. (2)
* 8965771 Use of avatar with event processing 0 2003
* 2005/0125,229 Use of avatar with event processing 30 2003
 
PAYPAL, INC. (2)
* 7895268 Multiple perspective activity map display 0 2001
* 2002/0133,548 System and method for a distributed social proxy 2 2001
 
SEARETE LLC (1)
* 2006/0279,530 Physical interaction-sensitive user interface 3 2005
 
INSIGHT ACOUSTIC LTD. (2)
9596554 Methods circuits devices systems and associated computer executable code for acquiring acoustic signals 1 2015
* 9838785 Methods circuits devices systems and associated computer executable code for acquiring acoustic signals 1 2017
 
UNILOC LUXEMBOURG S.A. (1)
* 7216351 Systems and methods for synchronizing multi-modal interactions 102 2000
 
MICROSOFT TECHNOLOGY LICENSING, LLC (318)
* 7203635 Layered models for context awareness 40 2002
* 2004/0002,838 Layered models for context awareness 30 2002
8745541 Architecture for controlling a computer using hand gestures 44 2003
7769809 Associating real-time conversations with a logical conversation 2 2005
* 2007/0033,250 Real-time conversation thread 58 2005
* 2007/0033,249 Multimodal conversation 11 2005
* 2007/0124,263 Adaptive semantic reasoning engine 39 2005
* 7627536 Dynamic interaction menus from natural language representations 11 2006
* 2007/0288,404 Dynamic interaction menus from natural language representations 7 2006
* 2008/0055,316 Programmatically representing sentence meaning with animation 0 2006
8436815 Selective enabling of multi-input controls 17 2007
* 2008/0291,174 Selective enabling of multi-input controls 8 2007
* 2008/0259,055 Manipulating An Object Utilizing A Pointing Device 5 2008
8456419 Determining a position of a pointing device 7 2008
* 2008/0204,410 RECOGNIZING A MOTION OF A POINTING DEVICE 8 2008
9454244 Recognizing a movement of a pointing device 0 2008
8385557 Multichannel acoustic echo reduction 11 2008
8325909 Acoustic echo suppression 2 2008
8294767 Body scan 3 2009
8267781 Visual target tracking 15 2009
8487938 Standard Gestures 6 2009
8707216 Controlling objects via gesturing 7 2009
8773355 Adaptive cursor sizing 0 2009
9256282 Virtual object manipulation 1 2009
8988437 Chaining animations 1 2009
* 2010/0241,998 VIRTUAL OBJECT MANIPULATION 20 2009
8448094 Mapping a natural input device to a legacy system 3 2009
* 2010/0199,229 MAPPING A NATURAL INPUT DEVICE TO A LEGACY SYSTEM 14 2009
9313376 Dynamic depth power equalization 2 2009
9377857 Show body position 0 2009
9015638 Binding users to a gesture based system and providing feedback to the users 2 2009
8253746 Determine intended motions 30 2009
* 2010/0281,432 SHOW BODY POSITION 57 2009
9498718 Altering a view perspective within a display environment 1 2009
9400559 Gesture shortcuts 0 2009
9383823 Combining gestures beyond skeletal 0 2009
8942428 Isolate extraneous motions 7 2009
8856691 Gesture tool 5 2009
8744121 Device for identifying and tracking multiple humans over time 20 2009
8649554 Method to control perspective for a camera-controlled computer 4 2009
8542252 Target digitization, extraction, and tracking 7 2009
8418085 Gesture coach 38 2009
8379101 Environment and/or target segmentation 32 2009
* 2010/0302,365 Depth Image Noise Reduction 10 2009
* 2010/0306,685 USER MOVEMENT FEEDBACK VIA ON-SCREEN AVATARS 21 2009
* 2010/0302,247 Target digitization, extraction, and tracking 50 2009
8487871 Virtual desktop coordinate transformation 6 2009
* 2010/0302,145 VIRTUAL DESKTOP COORDINATE TRANSFORMATION 21 2009
8320619 Systems and methods for tracking a model 9 2009
8625837 Protocol and format for communicating an image from a camera to a computing environment 0 2009
8509479 Virtual object 1 2009
8340432 Systems and methods for detecting a tilt angle from a depth image 14 2009
9182814 Systems and methods for estimating a non-visible or occluded body part 2 2009
8390680 Visual representation expression based on player expression 5 2009
9159151 Bringing a visual representation to life via learned input from the user 1 2009
8264536 Depth-sensitive imaging via polarization-state mapping 20 2009
9141193 Techniques for using human gestures to control gesture unaware programs 0 2009
8508919 Separation of electrical and optical components 0 2009
8330134 Optical fault monitoring 0 2009
8976986 Volume adjustment based on listener position 0 2009
8760571 Alignment of lens and image sensor 0 2009
8428340 Screen space plane identification 4 2009
8452087 Image selection techniques 4 2009
* 2011/0075,921 Image Selection Techniques 5 2009
8723118 Imager for constructing color and depth images 3 2009
8867820 Systems and methods for removing a background of an image 3 2009
8564534 Human tracking system 20 2009
9400548 Gesture personalization and profile roaming 1 2009
8295546 Pose tracking pipeline 14 2009
8988432 Systems and methods for processing an image for target tracking 1 2009
8963829 Methods and systems for determining and tracking extremities of a target 8 2009
8843857 Distance scalable no touch computing 29 2009
* 2011/0119,640 DISTANCE SCALABLE NO TOUCH COMPUTING 116 2009
8682028 Visual target tracking 3 2009
8588465 Visual target tracking 4 2009
8577084 Visual target tracking 1 2009
8577085 Visual target tracking 1 2009
8565476 Visual target tracking 1 2009
8565477 Visual target tracking 4 2009
9244533 Camera navigation for presentations 2 2009
8320621 Depth projector system with integrated VCSEL array 45 2009
9268404 Application gesture interpretation 0 2010
9019201 Evolving universal gesture sets 3 2010
8631355 Assigning gesture dictionaries 30 2010
8933884 Tracking groups of users in motion capture system 2 2010
8676581 Speech recognition analysis via identification information 8 2010
8265341 Voice-body identity correlation 6 2010
8864581 Visual based identitiy tracking 5 2010
8687044 Depth camera compatibility 2 2010
8619122 Depth camera compatibility 1 2010
8717469 Fast gating photosurface 6 2010
8659658 Physical interaction zone for gesture-based user interfaces 45 2010
8499257 Handles interactions for human—computer interface 4 2010
9652042 Architecture for controlling a computer using hand gestures 0 2010
8633890 Gesture detection based on joint skipping 4 2010
* 2011/0199,302 CAPTURING SCREEN OBJECTS USING A COLLISION VOLUME 8 2010
8928579 Interacting with an omni-directionally projected display 0 2010
8655069 Updating image segmentation following user input 14 2010
8422769 Image segmentation using reduced foreground training data 12 2010
8411948 Up-sampling binary images for segmentation 11 2010
8279418 Raster scanning for depth detection 1 2010
8213680 Proxy training data for human body tracking 20 2010
8514269 De-aliasing depth images 3 2010
8523667 Parental control settings based on body dimensions 15 2010
8605763 Temperature measurement and control for laser and light-emitting diodes 7 2010
9098873 Motion-based interactive shopping environment 3 2010
8351651 Hand-location post-process refinement in a tracking system 27 2010
8379919 Multiple centroid condensation of probability distribution clouds 4 2010
8284847 Detecting motion for a multifunction sensor device 27 2010
8885890 Depth map confidence filtering 2 2010
8498481 Image segmentation using star-convexity constraints 3 2010
8457353 Gestures and gesture modifiers for manipulating a user-interface 17 2010
8693724 Method and system implementing user-centric gesture control 21 2010
8803888 Recognition system for sharing information 6 2010
9008355 Automatic depth camera aiming 0 2010
8751215 Machine based sign language interpreter 3 2010
9557574 Depth illumination and detection optics 0 2010
8330822 Thermally-tuned depth camera light source 4 2010
9384329 Caloric burn determination from body movement 0 2010
8749557 Interacting with user interface via avatar 4 2010
8675981 Multi-modal gender recognition including depth data 0 2010
8982151 Independently processing planes of display data 1 2010
8670029 Depth camera illuminator with superluminescent light-emitting diode 22 2010
8558873 Use of wavefront coding to create a depth image 7 2010
8296151 Compound gesture-speech commands 23 2010
8381108 Natural user input for driving interactive stories 2 2010
9898675 User movement tracking feedback to improve tracking 0 2010
8416187 Item navigation using motion-capture data 3 2010
9075434 Translating user motion into multiple object responses 1 2010
8613666 User selection and navigation based on looped motions 7 2010
8437506 System for fast, probabilistic skeletal tracking 9 2010
8988508 Wide angle field of view active illumination imaging system 2 2010
8681255 Integrated low power depth camera and projection device 4 2010
8548270 Time-of-flight depth imaging 1 2010
9484065 Intelligent determination of replays based on event identification 1 2010
9298263 Show body position 0 2010
8467574 Body scan 2 2010
8592739 Detection of configuration changes of an optical element in an illumination system 1 2010
8866889 In-home depth camera calibration 5 2010
8667519 Automatic passive and anonymous feedback system 8 2010
9349040 Bi-modal depth-image analysis 2 2010
8553934 Orienting the position of a sensor 0 2010
8618405 Free-space gesture musical instrument digital interface (MIDI) controller 7 2010
8408706 3D gaze tracker 9 2010
9171264 Parallel processing machine learning decision tree training 1 2010
8920241 Gesture controlled persistent handles for interface guides 1 2010
8884968 Modeling an object from image data 1 2010
8448056 Validation analysis of human target 5 2010
8803952 Plural detector time-of-flight depth mapping 2 2010
8660303 Detection of body and props 14 2010
9848106 Intelligent gameplay photo capture 0 2010
9821224 Driving simulator control with virtual skeleton 0 2010
9823339 Plural anode time-of-flight sensor 0 2010
8994718 Skeletal control of three-dimensional virtual world 4 2010
8385596 First person shooter control with virtual skeleton 7 2010
9123316 Interactive content creation 1 2010
8488888 Classification of posture states 7 2010
9247238 Reducing interference between multiple infra-red depth cameras 1 2011
8891067 Multiple synchronized optical sources for time-of-flight range finding systems 1 2011
8587583 Three-dimensional environment reconstruction 22 2011
8401225 Moving object segmentation using depth images 23 2011
8401242 Real-time camera tracking using depth maps 19 2011
8724887 Environmental modifications to mitigate environmental factors 0 2011
8629976 Methods and systems for hierarchical de-aliasing time-of-flight (TOF) systems 2 2011
8942917 Change invariant scene recognition by an agent 7 2011
8497838 Push actuation of interface controls 4 2011
8638985 Human body pose estimation 12 2011
9551914 Illuminator with refractive optical element 11 2011
9067136 Push personalization of interface controls 0 2011
8571263 Predicting joint positions 4 2011
9470778 Learning from high quality depth measurements 0 2011
9298287 Combined activation for natural user interface systems 0 2011
8824749 Biometric recognition 6 2011
8503494 Thermal management system 0 2011
8620113 Laser diode modes 10 2011
8888331 Low inductance light source module 0 2011
9137463 Adaptive high dynamic range camera 2 2011
8788973 Three-dimensional gesture controlled avatar configuration interface 3 2011
8760395 Gesture recognition techniques 12 2011
9594430 Three-dimensional foreground selection for vision system 0 2011
8526734 Three-dimensional background removal for vision system 3 2011
8578302 Predictive determination 1 2011
* 2011/0234,490 Predictive Determination 4 2011
9597587 Locational node device 1 2011
8325984 Systems and methods for tracking a model 22 2011
9054764 Sensor array beamformer post-processor 0 2011
8818002 Robust adaptive beamforming with enhanced noise suppression 2 2011
9280203 Gesture recognizer system architecture 0 2011
8869072 Gesture recognizer system architecture 0 2011
9098110 Head rotation tracking from depth-based center of mass 0 2011
8786730 Image exposure using exclusion regions 0 2011
8597142 Dynamic camera based practice mode 20 2011
9259643 Control of separate computer game elements 0 2011
8702507 Manual and camera-based avatar control 1 2011
8897491 System for finger recognition and tracking 8 2011
9724600 Controlling objects in a virtual environment 0 2011
9557836 Depth image compression 0 2011
9117281 Surface segmentation from RGB and depth images 3 2011
8782567 Gesture recognizer system architecture 4 2011
8483436 Systems and methods for tracking a model 15 2011
8854426 Time-of-flight camera with guided light 5 2011
9013489 Generation of avatar reflecting player appearance 3 2011
8929612 System for recognizing an open or closed hand 4 2011
8724906 Computing pose and/or shape of modifiable entities 10 2011
* 8954330 Context-aware interaction system using a semantic model 0 2011
* 2013/0138,424 Context-Aware Interaction System Using a Semantic Model 9 2011
8509545 Foreground subject detection 1 2011
9039528 Visual target tracking 1 2011
8803800 User interface control based on head orientation 2 2011
9100685 Determining audience state or interest using passive sensor data 4 2011
8971612 Learning image processing tasks from scene reconstructions 6 2011
8879831 Using high-level attributes to guide image processing 1 2011
8630457 Problem states for pose tracking pipeline 0 2011
8811938 Providing a user interface experience based on inferred vehicle state 3 2011
9342139 Pairing a computing device to a user 0 2011
9720089 3D zoom imager 0 2012
8542910 Human tracking system 15 2012
8351652 Systems and methods for tracking a model 5 2012
8762894 Managing virtual ports 0 2012
8553939 Pose tracking pipeline 2 2012
9208571 Object digitization 1 2012
9069381 Interacting with a computer based application 1 2012
8968091 Scalable real-time motion recognition 0 2012
8926431 Visual based identity tracking 1 2012
8374423 Motion detection using depth images 9 2012
8363212 System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed 13 2012
8898687 Controlling a media program based on a media reaction 9 2012
9210401 Projected visual cues for guiding physical movement 1 2012
8959541 Determining a future portion of a currently presented media program 6 2012
9147253 Raster scanning for depth detection 1 2012
9836590 Enhanced accuracy of user presence status determination 0 2012
9007417 Body scan 0 2012
9646340 Avatar-based virtual dressing room 1 2012
8451278 Determine intended motions 6 2012
9696427 Wide angle depth detection 0 2012
9001118 Avatar construction using depth camera 7 2012
8781156 Voice-body identity correlation 1 2012
8565485 Pose tracking pipeline 17 2012
9063001 Optical fault monitoring 0 2012
9195305 Recognizing user intent in motion capture system 3 2012
8891827 Systems and methods for tracking a model 1 2012
8882310 Laser die light source module with low inductance 0 2012
8660310 Systems and methods for tracking a model 1 2012
8587773 System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed 15 2012
8503766 Systems and methods for detecting a tilt angle from a depth image 2 2012
8452051 Hand-location post-process refinement in a tracking system 9 2012
9857470 Using photometric stereo for 3D environment modeling 0 2012
8897493 Body scan 0 2013
8896721 Environment and/or target segmentation 0 2013
8588517 Motion detection using depth images 8 2013
9264807 Multichannel acoustic echo reduction 0 2013
9251590 Camera pose estimation for 3D reconstruction 2 2013
9052746 User center-of-mass and mass distribution extraction using depth images 4 2013
9274747 Natural user input for driving interactive stories 0 2013
8611607 Multiple centroid condensation of probability distribution clouds 1 2013
9242171 Real-time camera tracking using depth maps 7 2013
9519989 Visual representation expression based on player expression 0 2013
9135516 User body angle, curvature and average extremity positions extraction using depth images 4 2013
9092657 Depth image processing 0 2013
9274606 NUI video conference controls 0 2013
8787658 Image segmentation using reduced foreground training data 1 2013
8644609 Up-sampling binary images for segmentation 0 2013
9552126 Selective enabling of multi-input controls 0 2013
8610665 Pose tracking pipeline 1 2013
8953844 System for fast, probabilistic skeletal tracking 2 2013
8897495 Systems and methods for tracking a model 1 2013
8775916 Validation analysis of human target 26 2013
9262673 Human body pose estimation 2 2013
8929668 Foreground subject detection 0 2013
8917240 Virtual desktop coordinate transformation 0 2013
9191570 Systems and methods for detecting a tilt angle from a depth image 0 2013
8983233 Time-of-flight depth imaging 2 2013
9462253 Optical modules that reduce speckle contrast and diffraction artifacts 0 2013
8861839 Human tracking system 1 2013
9443310 Illumination modules that emit structured light 0 2013
9442186 Interference reduction for TOF systems 2 2013
9052382 System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed 0 2013
8970487 Human tracking system 1 2013
9842405 Visual target tracking 0 2013
9031103 Temperature measurement and control for laser and light-emitting diodes 0 2013
9769459 Power efficient laser diode driver circuit and method 0 2013
9508385 Audio-visual project generator 0 2013
8860663 Pose tracking pipeline 0 2013
9291449 Detection of configuration changes among optical elements of illumination system 0 2013
9215478 Protocol and format for communicating an image from a camera to a computing environment 0 2013
9468848 Assigning gesture dictionaries 1 2013
9679390 Systems and methods for removing a background of an image 1 2013
9524024 Method to control perspective for a camera-controlled computer 0 2014
9569005 Method and system implementing user-centric gesture control 0 2014
9656162 Device for identifying and tracking multiple humans over time 2 2014
9098493 Machine based sign language interpreter 1 2014
9372544 Gesture recognition techniques 2 2014
9292083 Interacting with user interface via avatar 1 2014
8908091 Alignment of lens and image sensor 0 2014
9596643 Providing a user interface experience based on inferred vehicle state 0 2014
9491226 Recognition system for sharing information 0 2014
9539500 Biometric recognition 0 2014
9522328 Human tracking system 0 2014
9465980 Pose tracking pipeline 2 2014
9056254 Time-of-flight camera with guided light 0 2014
9278287 Visual based identity tracking 0 2014
9582717 Systems and methods for tracking a model 2 2014
9619561 Change invariant scene recognition by an agent 0 2014
9659377 Methods and systems for determining and tracking extremities of a target 2 2014
9519828 Isolate extraneous motions 0 2014
9788032 Determining a future portion of a currently presented media program 0 2015
9821226 Human tracking system 0 2015
9478057 Chaining animations 0 2015
9489053 Skeletal control of three-dimensional virtual world 1 2015
9607213 Body scan 0 2015
9824260 Depth image processing 0 2015
9628844 Determining audience state or interest using passive sensor data 1 2015
9311560 Extraction of user behavior from depth images 1 2015
9529566 Interactive content creation 0 2015
9519970 Systems and methods for detecting a tilt angle from a depth image 0 2015
9787943 Natural user interface having video conference controls 0 2016
9824480 Chaining animations 0 2016
9910509 Method to control perspective for a camera-controlled computer 0 2016
 
GOOGLE INC. (2)
* 6807529 System and method for concurrent multimodal communication 191 2002
* 2003/0167,172 System and method for concurrent multimodal communication 10 2002
 
SYNC-THINK, INC. (2)
9265458 Application of smooth pursuit cognitive testing paradigms to clinical drug development 3 2012
9380976 Optical neuroinformatics 1 2013
 
WAYMO LLC (1)
* 9836895 Simulating virtual objects 0 2015
 
XTREME INTERACTIONS INC. (1)
9601113 System, device and method for processing interlaced multimodal user input 0 2013
 
ROVI GUIDES, INC. (1)
9674563 Systems and methods for recommending content 1 2013
 
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (1)
* 2012/0166,969 APPARATUS AND METHOD OF DATA TRANSFER 1 2008
 
OMRON CORPORATION and STANFORD UNIVERSITY (1)
* 2006/0282,493 Apparatus and method for socially intelligent virtual entity 5 2005
 
OUTLAND RESEARCH, LLC (1)
* 2006/0282,317 METHODS AND APPARATUS FOR CONVERSATIONAL ADVERTISING 30 2006
 
Extempo Systems, Inc. (1)
* 2002/0054,072 System, method, and device for an interactive messenger 12 2000
 
OSRAM SYLVANIA INC. (2)
* 9301372 Light control method and lighting device using the same 1 2011
* 2013/0120,238 LIGHT CONTROL METHOD AND LIGHTING DEVICE USING THE SAME 14 2011
 
LEIDOS, INC. (1)
7386799 Cinematic techniques in avatar-centric communication during a multi-user online simulation 269 2003
 
TATA CONSULTANCY SERVICES LIMITED (1)
* 2013/0167,025 SYSTEM AND METHOD FOR ONLINE USER ASSISTANCE 0 2012
 
ZHIGU HOLDINGS LIMITED (2)
8635637 User interface presenting an animated avatar performing a media reaction 14 2011
9154837 User interface presenting an animated avatar performing a media reaction 3 2013
 
MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. (2)
* 7002584 Video information producing device 1 2001
* 2004/0027,353 Video information producing device 2 2003
 
STEVEN M. HOFFBERG 2004-1 GRAT (2)
8892495 Adaptive pattern recognition based controller apparatus and method and human-interface therefore 4 2013
9535563 Internet appliance system and method 1 2013
 
AT&T CORP. (1)
* 6941269 Method and system for providing automated audible backchannel responses 20 2001
* Cited By Examiner