Method and apparatus for embodied conversational characters with multimodal input/output in an interface device

Number of patents in Portfolio can not be more than 2000

United States of America Patent

PATENT NO 6570555
SERIAL NO

09223637

Stats

ATTORNEY / AGENT: (SPONSORED)

Importance

Loading Importance Indicators... loading....

Abstract

See full text

Deliberative and reactive processing are combined to process multi-modal inputs and direct movements and speech of a synthetic character that operates as an interface between a user and a piece of equipment. The synthetic character is constructed as an ally, working with and helping the user learn and operate the equipment. The synthetic character interacts with both a virtual space where the character is displayed, and a physical space (domain) that includes the user. Real-time reactive processing provides lifelike and engaging responses to user queries and conversations. Deliberative processing provides responses to inputs that require more processing time (deep linguistic processing, for example). Knowledge bases are maintained for both dynamic (discourse model, for example) and static (e.g., knowledge about the domain or discourse plans) information types. A rule based system is utilized against the knowledge bases and selected inputs from said user to determine input meanings, and follow a predetermined discourse plan.

Loading the Abstract Image... loading....

First Claim

See full text

Family

Loading Family data... loading....

Patent Owner(s)

Patent OwnerAddressTotal Patents
FUJI XEROX CO., LTD.TOKYO7693
XEROX CORPORATIONSTAMFORD, CT13750

International Classification(s)

  • [Classification Symbol]
  • [Patents Count]

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Bickmore, Timothy W Somerville, MA 8 1020
Churchill, Elizabeth San Francisco, CA 19 638
Girgensohn, Andreas Menlo Park, CA 55 2245
Prevost, Scott A San Francisco, CA 6 630
Sullivan, Joseph W San Francisco, CA 11 1141

Cited Art Landscape

Patent Info (Count) # Cites Year
 
MASSACHUSETTS INSTITUTE OF TECHNOLOGY (1)
5563988 Method and system for facilitating wireless, full-body, real-time user interaction with a digitally represented visual environment 464 1994
 
INTERNATIONAL BUSINESS MACHINES CORPORATION (2)
* 5157384 Advanced user interface 220 1989
* 5936624 Data processing system having a logical containment system and method therefor 20 1997
 
AVID TECHNOLOGY, INC. (1)
* 6084569 Editing interface 6 1997
 
SIERRA ENTERTAINMENT, INC. (1)
* 5111409 Authoring and use systems for sound synchronized animation 230 1989
 
U.S. PHILIPS CORPORATION (1)
* 6075515 Virtual workspace for tactual interaction 4 1998
 
AVAYA INC. (1)
* 6012030 Management of speech and audio prompts in multimodal interfaces 109 1998
 
TAIWAN SEMICONDUCTOR MANUFACTURING COMPANY, LTD. (1)
* 4965741 Method for providing an improved human user interface to a knowledge based system 76 1988
 
Aerospatiale Societe Nationale Industrielle (1)
* 6072473 Method and device for multimode and multifunction communication between an operator and one or more processors 50 1994
 
SINGAPORE COMPUTER SYSTEMS LIMITED (1)
* 5432887 Neural network system and method for factory floor scheduling 39 1993
 
UCHICAGO ARGONNE, LLC (1)
* 6058387 Dynamic information architecture system and method 26 1996
 
COMPASSLEARNING, INC. (1)
* 5310349 Instructional management system 326 1992
* Cited By Examiner

Patent Citation Ranking

Forward Cite Landscape

Patent Info (Count) # Cites Year
 
Other [Check patent profile for assignment information] (9)
* 7225233 System and method for interactive, multimedia entertainment, education or other experience, and revenue generation therefrom 9 2000
* 2001/0047,346 Artificial intelligence and computer interface 4 2001
7137861 Interactive three-dimensional multimedia I/O device for a computer 5 2003
* 2004/0103,222 INTERACTIVE THREE-DIMENSIONAL MULTIMEDIA I/O DEVICE FOR A COMPUTER 0 2003
* 2007/0174,235 Method of using digital characters to compile information 2 2006
* 2007/0260,695 System and method for interactive, multimedia entertainment, education or other experience, and revenue generation therefrom 5 2007
* 2008/0114,848 Overlaid Display of Messages in the User Interface of Instant Messaging and Other Digital Communication Services 6 2007
8714982 System and method for teaching social skills, social thinking, and social awareness 0 2008
* 2009/0097,757 SYSTEM AND METHOD FOR TEACHING SOCIAL SKILLS, SOCIAL THINKING, AND SOCIAL AWARENESS 3 2008
 
VOICEBOX TECHNOLOGIES CORPORATION (29)
8073681 System and method for a cooperative conversational voice user interface 165 2006
7818176 System and method for selecting and presenting advertisements based on natural language processing of voice-based input 168 2007
8140335 System and method for providing a natural language voice user interface in an integrated voice navigation services environment 146 2007
8589161 System and method for an integrated, multi-modal, multi-device natural language voice services environment 23 2008
8326637 System and method for processing multi-modal device interactions in a natural language voice services environment 35 2009
9171541 System and method for hybrid processing in a natural language voice services environment 8 2010
8145489 System and method for selecting and presenting advertisements based on natural language processing of voice-based input 37 2010
9502025 System and method for providing a natural language content dedication service 5 2010
8515765 System and method for a cooperative conversational voice user interface 27 2011
8452598 System and method for providing advertisements in an integrated voice navigation services environment 31 2011
8370147 System and method for providing a natural language voice user interface in an integrated voice navigation services environment 33 2011
8326627 System and method for dynamically generating a recognition grammar in an integrated voice navigation services environment 34 2011
8527274 System and method for delivering targeted advertisements and tracking advertisement interactions in voice recognition contexts 24 2012
8719009 System and method for processing multi-modal device interactions in a natural language voice services environment 20 2012
8983839 System and method for dynamically generating a recognition grammar in an integrated voice navigation services environment 11 2012
8738380 System and method for processing multi-modal device interactions in a natural language voice services environment 20 2012
8719026 System and method for providing a natural language voice user interface in an integrated voice navigation services environment 19 2013
9015049 System and method for a cooperative conversational voice user interface 11 2013
8886536 System and method for delivering targeted advertisements and tracking advertisement interactions in voice recognition contexts 12 2013
9305548 System and method for an integrated, multi-modal, multi-device natural language voice services environment 9 2013
9620113 System and method for providing a natural language voice user interface 0 2014
9105266 System and method for processing multi-modal device interactions in a natural language voice services environment 7 2014
9263039 Systems and methods for responding to natural language speech utterance 2 2014
9269097 System and method for delivering targeted advertisements and/or providing natural language processing based on advertisements 8 2014
9570070 System and method for processing multi-modal device interactions in a natural language voice services environment 0 2015
9406078 System and method for delivering targeted advertisements and/or providing natural language processing based on advertisements 5 2015
9626703 Voice commerce 0 2015
9747896 System and method for providing follow-up responses to prior natural language inputs of a user 0 2015
9711143 System and method for an integrated, multi-modal, multi-device natural language voice services environment 0 2016
 
SONY CORPORATION (4)
* 7426467 System and method for supporting interactive user interface operations and storage medium 144 2001
* 2002/0010,589 System and method for supporting interactive operations and storage medium 22 2001
* 7523084 Action evaluation apparatus and method 1 2006
* 2006/0293,900 Action evaluation apparatus and method 0 2006
 
THE INVENTION SCIENCE FUND I, LLC (4)
8626731 Component information and auxiliary information related to information management 2 2007
* 2008/0189,112 Component information and auxiliary information related to information management 7 2007
* 8055648 Managing information related to communication 0 2007
9158771 Component information and auxiliary information related to information management 0 2013
 
SAMSUNG ELECTRONICS CO., LTD. (3)
* 7734468 Method of and apparatus for managing dialog between user and agent 4 2003
* 2004/0122,673 Method of and apparatus for managing dialog between user and agent 13 2003
* 2010/0182,324 DISPLAY APPARATUS AND DISPLAY METHOD FOR PERFORMING ANIMATION OPERATIONS 2 2009
 
ORACLE AMERICA, INC. (1)
* 2004/0210,431 Method and apparatus for accelerated post-silicon testing and random number generation 1 2003
 
AT&T INTELLECTUAL PROPERTY I, L.P. (1)
* 8823793 System and method for performing security tasks 3 2008
 
ORACLE INTERNATIONAL CORPORATION (4)
* 7334183 Domain-specific concatenative audio 8 2003
* 2004/0138,887 Domain-specific concatenative audio 6 2003
* 7418434 Forward-chaining inferencing 13 2005
* 2005/0240,546 FORWARD-CHAINING INFERENCING 8 2005
 
INTELLIJAX CORPORATION (2)
* 9552739 Computer-based tutoring method and system 0 2009
* 2009/0298,039 Computer-Based Tutoring Method and System 6 2009
 
AVAYA INC. (13)
* 2004/0034,531 Distributed multimodal dialogue system and method 16 2002
8489442 Interface for meeting facilitation and coordination, method and apparatus 11 2004
7984378 Management of meetings by grouping 3 2006
8600794 Meeting notification and merging agents 0 2006
* 2007/0265,903 Meeting notification and merging agents 15 2006
7778858 Linking unable to respond messages to entries in electronic calendar 7 2006
8037143 Automatic display of email distribution lists 7 2006
7693736 Recurring meeting schedule wizard 25 2006
7827240 Calendar item hierarchy for automatic specialization 12 2007
8060565 Voice and text session converter 16 2007
8706539 Interface for meeting facilitation and coordination, method and apparatus 0 2009
8230034 Automatic display of email distribution lists 1 2011
* 2011/0225,254 AUTOMATIC DISPLAY OF EMAIL DISTRIBUTION LISTS 9 2011
 
KONINKLIJKE PHILIPS ELECTRONICS N.V. (1)
* 2003/0123,728 Interactive video installation and method thereof 2 2001
 
DISNEY ENTERPRISES, INC. (1)
* 9811937 Coordinated gesture and locomotion for virtual pedestrians 0 2015
 
Exbibuo B.V. (1)
7606741 Information gathering system and method 132 2005
 
LOCKHEED MARTIN CORPORATION (2)
* 8615383 Immersive collaborative environment using motion capture, head mounted display, and cave 5 2009
* 2009/0187,389 Immersive Collaborative Environment Using Motion Capture, Head Mounted Display, and Cave 27 2009
 
UNIVERSITY OF FLORIDA RESEARCH FOUNDATION, INC. (1)
* 2005/0255,434 Interactive virtual characters for training including medical diagnosis training 34 2005
 
RAKUTEN, INC. (3)
* 7373292 Text-to-scene conversion 5 2005
7962329 Text-to-scene conversion 0 2008
8086028 Text-to-scene conversion 1 2009
 
INTERNATIONAL BUSINESS MACHINES CORPORATION (8)
* 8719200 Cyberpersonalities in artificial reality 5 2007
* 2009/0254,417 HYDRATE-BASED DESALINATION USING COMPOUND PERMEABLE RESTRAINT PANELS AND VAPORIZATION-BASED COOLING 21 2007
* 8244776 Method and device for customizing a mail history 0 2008
* 2009/0144,339 METHOD AND DEVICE FOR CUSTOMIZING A MAIL HISTORY 0 2008
8645432 Method and device for customizing a mail history 0 2012
* 9369410 Chatbots 1 2014
* 9213940 Cyberpersonalities in artificial reality 0 2014
9794199 Chatbots 0 2016
 
SAP SE (2)
* 8594997 Context-aware conversational user interface 1 2010
* 2012/0078,611 CONTEXT-AWARE CONVERSATIONAL USER INTERFACE 7 2010
 
HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. (3)
7593854 Method and system for collecting user-interest information regarding a picture 4 2002
* 2003/0144,843 Method and system for collecting user-interest information regarding a picture 22 2002
* 2003/0112,267 Multi-modal picture 60 2002
 
LUCENT TECHNOLOGIES INC. (1)
* 2010/0074,460 SELF-STEERING DIRECTIONAL HEARING AID AND METHOD OF OPERATION THEREOF 11 2008
 
CISCO TECHNOLOGY, INC. (2)
* 9317953 Coordinated 2-dimensional and 3-dimensional graphics processing 1 2011
* 2013/0293,537 Coordinated 2-Dimensional and 3-Dimensional Graphics Processing 0 2011
 
Leviathan Entertainment, LLC (1)
* 2007/0087,819 Financial institutions and instruments in a virtual environment 61 2006
 
CJ CGV CO., LTD. (1)
* 2015/0163,447 METHOD FOR GENERATING IMAGES FOR MULTI-PROJECTION THEATER AND IMAGE MANAGEMENT APPARATUS USING THE SAME 0 2014
 
MOTOROLA, INC. (1)
* 2005/0165,601 Method and apparatus for determining when a user has ceased inputting data 1 2004
 
FUJI XEROX CO., LTD. (4)
* 7809792 Conference information processing apparatus, and conference information processing method and storage medium readable by computer 3 2004
* 2005/0210,105 Conference information processing apparatus, and conference information processing method and storage medium readable by computer 17 2004
7783106 Video segmentation combining similarity analysis and classification 8 2004
* 2006/0107,216 Video segmentation combining similarity analysis and classification 11 2004
 
BRITISH TELECOMMUNICATIONS PUBLIC LIMITED COMPANY (2)
* 2005/0172,232 Synchronisation in multi-modal interfaces 16 2004
* 2007/0250,841 Multi-modal interface 44 2007
 
STARS 1-TO-1 (1)
* 2002/0010,584 Interactive voice communication method and system for information and entertainment 120 2001
 
MICE TECHNOLOGIES, INC. (1)
* 2006/0250,352 System and method for improved cursor functionality 4 2005
 
INTEL CORPORATION (3)
* 8977972 Using multi-modal input to control multiple objects on a display 1 2009
* 2011/0161,890 Using multi-modal input to control multiple objects on a display 33 2009
9600296 Executing a command within a transport mechanism based on a get and set architecture 0 2012
 
SOFFINO, LLC. (1)
* 2006/0041,848 Overlaid display of messages in the user interface of instant messaging and other digital communication services 43 2005
 
MICROSOFT CORPORATION (2)
8634636 Systems and methods for removing a background of an image 0 2009
8824780 Human tracking system 0 2013
 
MICROSOFT INTERNATIONAL HOLDINGS B.V. (2)
8681321 Gated 3D camera 2 2009
9641825 Gated 3D camera 0 2014
 
ROBERT D. LINDNER, JR. (2)
6865370 Learning method and system based on questioning 16 2003
* 2004/0110,120 Learning method and system based on questioning 8 2003
 
NUANCE COMMUNICATIONS, INC. (50)
* 7729918 Trainable sentence planning system 44 2002
* 7574362 Method for automated sentence planning in a task classification system 43 2002
* 7516076 Automated sentence planning in a task classification system 45 2002
* 2003/0110,037 Automated sentence planning in a task classification system 47 2002
* 2003/0097,249 Trainable sentence planning system 52 2002
7398209 Systems and methods for responding to natural language speech utterance 223 2003
7693720 Mobile systems and methods for responding to natural language speech utterance 374 2003
* 7117155 Coarticulation method for audio-visual text-to-speech synthesis 0 2003
* 2004/0064,321 Coarticulation method for audio-visual text-to-speech synthesis 3 2003
* 7617105 Converting text-to-speech and adjusting corpus 9 2005
* 2005/0267,758 Converting text-to-speech and adjusting corpus 8 2005
7640160 Systems and methods for responding to natural language speech utterance 186 2005
* 2007/0033,005 Systems and methods for responding to natural language speech utterance 83 2005
7620549 System and method of supporting adaptive misrecognition in conversational speech 178 2005
* 2007/0038,436 System and method of supporting adaptive misrecognition in conversational speech 166 2005
7949529 Mobile systems and methods of supporting natural language human-machine interactions 341 2005
* 2007/0050,191 Mobile systems and methods of supporting natural language human-machine interactions 199 2005
* 7392190 Coarticulation method for audio-visual text-to-speech synthesis 1 2006
7634409 Dynamic speech sharpening 166 2006
* 2007/0055,525 Dynamic speech sharpening 100 2006
7502738 Systems and methods for responding to natural language speech utterance 168 2007
* 2007/0265,850 SYSTEMS AND METHODS FOR RESPONDING TO NATURAL LANGUAGE SPEECH UTTERANCE 65 2007
8015006 Systems and methods for processing natural language speech utterances with context-specific domain agents 194 2008
7809570 Systems and methods for responding to natural language speech utterance 167 2008
* 2008/0319,751 SYSTEMS AND METHODS FOR RESPONDING TO NATURAL LANGUAGE SPEECH UTTERANCE 54 2008
8731929 Agent architecture for determining meanings of natural language utterances 14 2009
8019610 Automated sentence planning in a task classification system 35 2009
7949537 Method for automated sentence planning in a task classification system 42 2009
8332224 System and method of supporting adaptive misrecognition conversational speech 73 2009
8069046 Dynamic speech sharpening 155 2009
7983917 Dynamic speech sharpening 157 2009
7917367 Systems and methods for responding to natural language speech utterance 161 2009
9031845 Mobile systems and methods for responding to natural language speech utterance 2 2010
8140327 System and method for filtering and eliminating noise from natural language utterances to improve speech recognition and parsing 41 2010
8112275 System and method for user-specific speech recognition 154 2010
8185401 Automated sentence planning in a task classification system 0 2010
8155962 Method and system for asynchronously processing natural language utterances 41 2010
8326634 Systems and methods for responding to natural language speech utterance 49 2011
8620659 System and method of supporting adaptive misrecognition in conversational speech 56 2011
8195468 Mobile systems and methods of supporting natural language human-machine interactions 65 2011
8209186 Method for automated sentence planning in a task classification system 0 2011
* 2011/0218,807 Method for Automated Sentence Planning in a Task Classification System 0 2011
8150694 System and method for providing an acoustic grammar to dynamically sharpen speech interpretation 74 2011
8180647 Automated sentence planning in a task classification system 10 2011
8620669 Automated sentence planning in a task classification system 2 2012
8447607 Mobile systems and methods of supporting natural language human-machine interactions 159 2012
8849670 Systems and methods for responding to natural language speech utterance 19 2012
8849652 Mobile systems and methods of supporting natural language human-machine interactions 13 2013
9626959 System and method of supporting adaptive misrecognition in conversational speech 0 2013
9495957 Mobile systems and methods of supporting natural language human-machine interactions 1 2014
 
OMRON CORPORATION (2)
7944448 Apparatus and method for socially intelligent virtual entity 10 2005
* 2006/0248,461 Socially intelligent agent software 8 2006
 
INTERACTIVE BID GAMES, INC. (1)
* 2013/0304,599 METHOD AND SYSTEM OF CONDUCTING INTERACTIVE ONLINE AUCTIONS 0 2013
 
ZOESIS, INC. (4)
* 7478047 Interactive character system 82 2001
* 2004/0075,677 Interactive character system 112 2003
* 2008/0120,113 INTERACTIVE CHARACTER SYSTEM 18 2007
* 2011/0016,004 INTERACTIVE CHARACTER SYSTEM 23 2010
 
XEROX CORPORATION (1)
* 2003/0193,504 System for designing and rendering personalities for autonomous synthetic characters 10 2003
 
NOKIA TECHNOLOGIES OY (1)
9507481 Method and apparatus for determining an invocation input based on cognitive load 0 2013
 
LINDNER, JR., ROBERT D. (2)
* 2002/0128,818 Method and system to answer a natural-language question 20 2002
* 2003/0224,341 LEARNING METHOD AND SYSTEM BASED ON QUESTIONING 1 2002
 
MASSACHUSETTS INSTITUTE OF TECHNOLOGY (2)
* 7642989 System for and method of motion and force synchronization with time delay reduction in multi-user shared virtual environments 7 2006
* 2006/0256,080 System for and method of motion and force synchronization with time delay reduction in multi-user shared virtual environments 1 2006
 
Kurzweil AINetworks, Inc. (2)
* 8965771 Use of avatar with event processing 0 2003
* 2005/0125,229 Use of avatar with event processing 29 2003
 
PAYPAL, INC. (2)
* 7895268 Multiple perspective activity map display 0 2001
* 2002/0133,548 System and method for a distributed social proxy 2 2001
 
SEARETE LLC (1)
* 2006/0279,530 Physical interaction-sensitive user interface 3 2005
 
INSIGHT ACOUSTIC LTD. (1)
9596554 Methods circuits devices systems and associated computer executable code for acquiring acoustic signals 0 2015
 
UNILOC LUXEMBOURG S.A. (1)
* 7216351 Systems and methods for synchronizing multi-modal interactions 100 2000
 
MICROSOFT TECHNOLOGY LICENSING, LLC (307)
* 7203635 Layered models for context awareness 35 2002
* 2004/0002,838 Layered models for context awareness 30 2002
8745541 Architecture for controlling a computer using hand gestures 29 2003
7769809 Associating real-time conversations with a logical conversation 2 2005
* 2007/0033,250 Real-time conversation thread 54 2005
* 2007/0033,249 Multimodal conversation 9 2005
* 2007/0124,263 Adaptive semantic reasoning engine 29 2005
* 7627536 Dynamic interaction menus from natural language representations 8 2006
* 2007/0288,404 Dynamic interaction menus from natural language representations 5 2006
* 2008/0055,316 Programmatically representing sentence meaning with animation 0 2006
8436815 Selective enabling of multi-input controls 15 2007
* 2008/0291,174 Selective enabling of multi-input controls 5 2007
* 2008/0259,055 Manipulating An Object Utilizing A Pointing Device 5 2008
8456419 Determining a position of a pointing device 6 2008
* 2008/0204,410 RECOGNIZING A MOTION OF A POINTING DEVICE 8 2008
9454244 Recognizing a movement of a pointing device 0 2008
8385557 Multichannel acoustic echo reduction 10 2008
8325909 Acoustic echo suppression 1 2008
8294767 Body scan 3 2009
8267781 Visual target tracking 14 2009
8487938 Standard Gestures 5 2009
8707216 Controlling objects via gesturing 5 2009
8773355 Adaptive cursor sizing 0 2009
9256282 Virtual object manipulation 0 2009
8988437 Chaining animations 0 2009
* 2010/0241,998 VIRTUAL OBJECT MANIPULATION 17 2009
8448094 Mapping a natural input device to a legacy system 2 2009
* 2010/0199,229 MAPPING A NATURAL INPUT DEVICE TO A LEGACY SYSTEM 10 2009
9313376 Dynamic depth power equalization 0 2009
9377857 Show body position 0 2009
9015638 Binding users to a gesture based system and providing feedback to the users 2 2009
8253746 Determine intended motions 28 2009
* 2010/0281,432 SHOW BODY POSITION 53 2009
9498718 Altering a view perspective within a display environment 0 2009
9400559 Gesture shortcuts 0 2009
9383823 Combining gestures beyond skeletal 0 2009
8942428 Isolate extraneous motions 6 2009
8856691 Gesture tool 0 2009
8744121 Device for identifying and tracking multiple humans over time 13 2009
8649554 Method to control perspective for a camera-controlled computer 4 2009
8542252 Target digitization, extraction, and tracking 6 2009
8418085 Gesture coach 28 2009
8379101 Environment and/or target segmentation 25 2009
* 2010/0302,365 Depth Image Noise Reduction 6 2009
* 2010/0306,685 USER MOVEMENT FEEDBACK VIA ON-SCREEN AVATARS 20 2009
* 2010/0302,247 Target digitization, extraction, and tracking 31 2009
8487871 Virtual desktop coordinate transformation 6 2009
* 2010/0302,145 VIRTUAL DESKTOP COORDINATE TRANSFORMATION 16 2009
8320619 Systems and methods for tracking a model 8 2009
8625837 Protocol and format for communicating an image from a camera to a computing environment 0 2009
8509479 Virtual object 1 2009
8340432 Systems and methods for detecting a tilt angle from a depth image 11 2009
9182814 Systems and methods for estimating a non-visible or occluded body part 1 2009
8390680 Visual representation expression based on player expression 4 2009
9159151 Bringing a visual representation to life via learned input from the user 0 2009
8264536 Depth-sensitive imaging via polarization-state mapping 17 2009
9141193 Techniques for using human gestures to control gesture unaware programs 0 2009
8508919 Separation of electrical and optical components 0 2009
8330134 Optical fault monitoring 0 2009
8976986 Volume adjustment based on listener position 0 2009
8760571 Alignment of lens and image sensor 0 2009
8428340 Screen space plane identification 3 2009
8452087 Image selection techniques 3 2009
* 2011/0075,921 Image Selection Techniques 3 2009
8723118 Imager for constructing color and depth images 2 2009
8867820 Systems and methods for removing a background of an image 3 2009
8564534 Human tracking system 17 2009
9400548 Gesture personalization and profile roaming 0 2009
8295546 Pose tracking pipeline 13 2009
8988432 Systems and methods for processing an image for target tracking 1 2009
8963829 Methods and systems for determining and tracking extremities of a target 6 2009
8843857 Distance scalable no touch computing 20 2009
* 2011/0119,640 DISTANCE SCALABLE NO TOUCH COMPUTING 90 2009
8682028 Visual target tracking 2 2009
8588465 Visual target tracking 3 2009
8577084 Visual target tracking 1 2009
8577085 Visual target tracking 1 2009
8565476 Visual target tracking 1 2009
8565477 Visual target tracking 4 2009
9244533 Camera navigation for presentations 1 2009
8320621 Depth projector system with integrated VCSEL array 37 2009
9268404 Application gesture interpretation 0 2010
9019201 Evolving universal gesture sets 2 2010
8631355 Assigning gesture dictionaries 24 2010
8933884 Tracking groups of users in motion capture system 2 2010
8676581 Speech recognition analysis via identification information 6 2010
8265341 Voice-body identity correlation 6 2010
8864581 Visual based identitiy tracking 4 2010
8687044 Depth camera compatibility 2 2010
8619122 Depth camera compatibility 1 2010
8717469 Fast gating photosurface 4 2010
8659658 Physical interaction zone for gesture-based user interfaces 33 2010
8499257 Handles interactions for human—computer interface 3 2010
9652042 Architecture for controlling a computer using hand gestures 0 2010
8633890 Gesture detection based on joint skipping 2 2010
* 2011/0199,302 CAPTURING SCREEN OBJECTS USING A COLLISION VOLUME 6 2010
8928579 Interacting with an omni-directionally projected display 0 2010
8655069 Updating image segmentation following user input 7 2010
8422769 Image segmentation using reduced foreground training data 7 2010
8411948 Up-sampling binary images for segmentation 6 2010
8279418 Raster scanning for depth detection 1 2010
8213680 Proxy training data for human body tracking 13 2010
8514269 De-aliasing depth images 3 2010
8523667 Parental control settings based on body dimensions 8 2010
8605763 Temperature measurement and control for laser and light-emitting diodes 4 2010
9098873 Motion-based interactive shopping environment 1 2010
8351651 Hand-location post-process refinement in a tracking system 22 2010
8379919 Multiple centroid condensation of probability distribution clouds 4 2010
8284847 Detecting motion for a multifunction sensor device 21 2010
8885890 Depth map confidence filtering 1 2010
8498481 Image segmentation using star-convexity constraints 3 2010
8457353 Gestures and gesture modifiers for manipulating a user-interface 13 2010
8693724 Method and system implementing user-centric gesture control 18 2010
8803888 Recognition system for sharing information 6 2010
9008355 Automatic depth camera aiming 0 2010
8751215 Machine based sign language interpreter 2 2010
9557574 Depth illumination and detection optics 0 2010
8330822 Thermally-tuned depth camera light source 4 2010
9384329 Caloric burn determination from body movement 0 2010
8749557 Interacting with user interface via avatar 3 2010
8675981 Multi-modal gender recognition including depth data 0 2010
8982151 Independently processing planes of display data 0 2010
8670029 Depth camera illuminator with superluminescent light-emitting diode 18 2010
8558873 Use of wavefront coding to create a depth image 5 2010
8296151 Compound gesture-speech commands 21 2010
8381108 Natural user input for driving interactive stories 1 2010
8416187 Item navigation using motion-capture data 3 2010
9075434 Translating user motion into multiple object responses 1 2010
8613666 User selection and navigation based on looped motions 5 2010
8437506 System for fast, probabilistic skeletal tracking 7 2010
8988508 Wide angle field of view active illumination imaging system 0 2010
8681255 Integrated low power depth camera and projection device 2 2010
8548270 Time-of-flight depth imaging 1 2010
9484065 Intelligent determination of replays based on event identification 1 2010
9298263 Show body position 0 2010
8467574 Body scan 1 2010
8592739 Detection of configuration changes of an optical element in an illumination system 1 2010
8866889 In-home depth camera calibration 4 2010
8667519 Automatic passive and anonymous feedback system 6 2010
9349040 Bi-modal depth-image analysis 1 2010
8553934 Orienting the position of a sensor 0 2010
8618405 Free-space gesture musical instrument digital interface (MIDI) controller 6 2010
8408706 3D gaze tracker 7 2010
9171264 Parallel processing machine learning decision tree training 0 2010
8920241 Gesture controlled persistent handles for interface guides 1 2010
8884968 Modeling an object from image data 1 2010
8448056 Validation analysis of human target 4 2010
8803952 Plural detector time-of-flight depth mapping 0 2010
8660303 Detection of body and props 12 2010
8994718 Skeletal control of three-dimensional virtual world 3 2010
8385596 First person shooter control with virtual skeleton 2 2010
9123316 Interactive content creation 1 2010
8488888 Classification of posture states 6 2010
9247238 Reducing interference between multiple infra-red depth cameras 0 2011
8891067 Multiple synchronized optical sources for time-of-flight range finding systems 1 2011
8587583 Three-dimensional environment reconstruction 13 2011
8401225 Moving object segmentation using depth images 18 2011
8401242 Real-time camera tracking using depth maps 13 2011
8724887 Environmental modifications to mitigate environmental factors 0 2011
8629976 Methods and systems for hierarchical de-aliasing time-of-flight (TOF) systems 1 2011
8942917 Change invariant scene recognition by an agent 6 2011
8497838 Push actuation of interface controls 4 2011
8638985 Human body pose estimation 9 2011
9551914 Illuminator with refractive optical element 2 2011
9067136 Push personalization of interface controls 0 2011
8571263 Predicting joint positions 4 2011
9470778 Learning from high quality depth measurements 0 2011
9298287 Combined activation for natural user interface systems 0 2011
8824749 Biometric recognition 5 2011
8503494 Thermal management system 0 2011
8620113 Laser diode modes 10 2011
8888331 Low inductance light source module 0 2011
9137463 Adaptive high dynamic range camera 0 2011
8788973 Three-dimensional gesture controlled avatar configuration interface 2 2011
8760395 Gesture recognition techniques 11 2011
9594430 Three-dimensional foreground selection for vision system 0 2011
8526734 Three-dimensional background removal for vision system 2 2011
8578302 Predictive determination 1 2011
* 2011/0234,490 Predictive Determination 4 2011
9597587 Locational node device 0 2011
8325984 Systems and methods for tracking a model 21 2011
9054764 Sensor array beamformer post-processor 0 2011
8818002 Robust adaptive beamforming with enhanced noise suppression 2 2011
9280203 Gesture recognizer system architecture 0 2011
8869072 Gesture recognizer system architecture 0 2011
9098110 Head rotation tracking from depth-based center of mass 0 2011
8786730 Image exposure using exclusion regions 0 2011
8597142 Dynamic camera based practice mode 8 2011
9259643 Control of separate computer game elements 0 2011
8702507 Manual and camera-based avatar control 1 2011
8897491 System for finger recognition and tracking 6 2011
9724600 Controlling objects in a virtual environment 0 2011
9557836 Depth image compression 0 2011
9117281 Surface segmentation from RGB and depth images 1 2011
8782567 Gesture recognizer system architecture 3 2011
8483436 Systems and methods for tracking a model 13 2011
8854426 Time-of-flight camera with guided light 2 2011
9013489 Generation of avatar reflecting player appearance 2 2011
8929612 System for recognizing an open or closed hand 2 2011
8724906 Computing pose and/or shape of modifiable entities 7 2011
* 8954330 Context-aware interaction system using a semantic model 0 2011
* 2013/0138,424 Context-Aware Interaction System Using a Semantic Model 9 2011
8509545 Foreground subject detection 1 2011
9039528 Visual target tracking 0 2011
8803800 User interface control based on head orientation 1 2011
9100685 Determining audience state or interest using passive sensor data 4 2011
8971612 Learning image processing tasks from scene reconstructions 4 2011
8879831 Using high-level attributes to guide image processing 1 2011
8630457 Problem states for pose tracking pipeline 0 2011
8811938 Providing a user interface experience based on inferred vehicle state 3 2011
9342139 Pairing a computing device to a user 0 2011
9720089 3D zoom imager 0 2012
8542910 Human tracking system 13 2012
8351652 Systems and methods for tracking a model 4 2012
8762894 Managing virtual ports 0 2012
8553939 Pose tracking pipeline 1 2012
9208571 Object digitization 0 2012
9069381 Interacting with a computer based application 1 2012
8968091 Scalable real-time motion recognition 0 2012
8926431 Visual based identity tracking 1 2012
8374423 Motion detection using depth images 7 2012
8363212 System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed 11 2012
8898687 Controlling a media program based on a media reaction 9 2012
9210401 Projected visual cues for guiding physical movement 1 2012
8959541 Determining a future portion of a currently presented media program 6 2012
9147253 Raster scanning for depth detection 1 2012
9007417 Body scan 0 2012
9646340 Avatar-based virtual dressing room 0 2012
8451278 Determine intended motions 3 2012
9696427 Wide angle depth detection 0 2012
9001118 Avatar construction using depth camera 2 2012
8781156 Voice-body identity correlation 1 2012
8565485 Pose tracking pipeline 12 2012
9063001 Optical fault monitoring 0 2012
9195305 Recognizing user intent in motion capture system 2 2012
8891827 Systems and methods for tracking a model 1 2012
8882310 Laser die light source module with low inductance 0 2012
8660310 Systems and methods for tracking a model 1 2012
8587773 System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed 13 2012
8503766 Systems and methods for detecting a tilt angle from a depth image 2 2012
8452051 Hand-location post-process refinement in a tracking system 7 2012
8897493 Body scan 0 2013
8896721 Environment and/or target segmentation 0 2013
8588517 Motion detection using depth images 5 2013
9264807 Multichannel acoustic echo reduction 0 2013
9251590 Camera pose estimation for 3D reconstruction 1 2013
9052746 User center-of-mass and mass distribution extraction using depth images 3 2013
9274747 Natural user input for driving interactive stories 0 2013
8611607 Multiple centroid condensation of probability distribution clouds 1 2013
9242171 Real-time camera tracking using depth maps 3 2013
9519989 Visual representation expression based on player expression 0 2013
9135516 User body angle, curvature and average extremity positions extraction using depth images 3 2013
9092657 Depth image processing 0 2013
9274606 NUI video conference controls 0 2013
8787658 Image segmentation using reduced foreground training data 0 2013
8644609 Up-sampling binary images for segmentation 0 2013
9552126 Selective enabling of multi-input controls 0 2013
8610665 Pose tracking pipeline 0 2013
8953844 System for fast, probabilistic skeletal tracking 0 2013
8897495 Systems and methods for tracking a model 1 2013
8775916 Validation analysis of human target 17 2013
9262673 Human body pose estimation 2 2013
8929668 Foreground subject detection 0 2013
8917240 Virtual desktop coordinate transformation 0 2013
9191570 Systems and methods for detecting a tilt angle from a depth image 0 2013
8983233 Time-of-flight depth imaging 0 2013
9462253 Optical modules that reduce speckle contrast and diffraction artifacts 0 2013
8861839 Human tracking system 0 2013
9443310 Illumination modules that emit structured light 0 2013
9442186 Interference reduction for TOF systems 2 2013
9052382 System architecture design for time-of-flight system having reduced differential pixel size, and time-of-flight systems so designed 0 2013
8970487 Human tracking system 1 2013
9031103 Temperature measurement and control for laser and light-emitting diodes 0 2013
9769459 Power efficient laser diode driver circuit and method 0 2013
9508385 Audio-visual project generator 0 2013
8860663 Pose tracking pipeline 0 2013
9291449 Detection of configuration changes among optical elements of illumination system 0 2013
9215478 Protocol and format for communicating an image from a camera to a computing environment 0 2013
9468848 Assigning gesture dictionaries 0 2013
9679390 Systems and methods for removing a background of an image 0 2013
9524024 Method to control perspective for a camera-controlled computer 0 2014
9569005 Method and system implementing user-centric gesture control 0 2014
9656162 Device for identifying and tracking multiple humans over time 0 2014
9098493 Machine based sign language interpreter 0 2014
9372544 Gesture recognition techniques 2 2014
9292083 Interacting with user interface via avatar 1 2014
8908091 Alignment of lens and image sensor 0 2014
9596643 Providing a user interface experience based on inferred vehicle state 0 2014
9491226 Recognition system for sharing information 0 2014
9539500 Biometric recognition 0 2014
9522328 Human tracking system 0 2014
9465980 Pose tracking pipeline 0 2014
9056254 Time-of-flight camera with guided light 0 2014
9278287 Visual based identity tracking 0 2014
9582717 Systems and methods for tracking a model 0 2014
9619561 Change invariant scene recognition by an agent 0 2014
9659377 Methods and systems for determining and tracking extremities of a target 1 2014
9519828 Isolate extraneous motions 0 2014
9788032 Determining a future portion of a currently presented media program 0 2015
9478057 Chaining animations 0 2015
9489053 Skeletal control of three-dimensional virtual world 0 2015
9607213 Body scan 0 2015
9628844 Determining audience state or interest using passive sensor data 1 2015
9311560 Extraction of user behavior from depth images 0 2015
9529566 Interactive content creation 0 2015
9519970 Systems and methods for detecting a tilt angle from a depth image 0 2015
9787943 Natural user interface having video conference controls 0 2016
 
SYNC-THINK, INC. (2)
9265458 Application of smooth pursuit cognitive testing paradigms to clinical drug development 2 2012
9380976 Optical neuroinformatics 0 2013
 
GOOGLE TECHNOLOGY HOLDINGS LLC (50)
* 6807529 System and method for concurrent multimodal communication 169 2002
* 2003/0167,172 System and method for concurrent multimodal communication 9 2002
7707039 Automatic modification of web pages 96 2004
9008447 Method and system for character recognition 0 2005
8515816 Aggregate analysis of text captures performed by multiple users from rendered documents 3 2005
8214387 Document enhancement system and method 25 2005
8019648 Search engines and systems with handheld document data capture devices 10 2005
7831912 Publishing techniques for adding value to a rendered document 67 2005
7742953 Adding information or functionality to a rendered document via association with an electronic counterpart 128 2005
7599580 Capturing text from rendered documents using supplemental information 94 2005
7599844 Content access with handheld document data capture devices 96 2005
7596269 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 80 2005
7593605 Data capture from rendered documents using handheld device 184 2005
7421155 Archive of text captures from rendered documents 153 2005
8713418 Adding value to a rendered document 16 2005
7702624 Processing techniques for visual capture data from a rendered document 51 2005
7818215 Processing techniques for text capture from a rendered document 132 2005
8005720 Applying scanned information to identify content 16 2005
7437023 Methods, systems and computer program products for data gathering in a digital and hard copy document environment 113 2005
7706611 Method and system for character recognition 55 2005
7812860 Handheld device for capturing text from both a document printed on paper and a document displayed on a dynamic display device 82 2005
7990556 Association of a portable scanner with input/output and storage devices 7 2006
8081849 Portable scanning and memory device 8 2007
8442331 Capturing text from rendered documents using supplemental information 5 2009
8489624 Processing techniques for text capture from a rendered document 4 2010
8638363 Automatically capturing information, such as capturing information using a document-aware device 4 2010
8418055 Identifying a document by performing spectral analysis on the contents of the document 24 2010
8990235 Automatically providing content associated with captured information, such as information captured in real-time 26 2010
8447066 Performing actions based on capturing information from rendered documents, such as documents under copyright 74 2010
8874504 Processing techniques for visual capture data from a rendered document 4 2010
8600196 Optical scanners, such as hand-held optical scanners 5 2010
8261094 Secure data gathering from rendered documents 2 2010
8346620 Automatic modification of web pages 14 2010
8179563 Portable scanning device 23 2010
9081799 Using gestalt information to identify locations in printed information 1 2010
9323784 Image search using text-based elements within the contents of images 2 2010
8620083 Method and system for character recognition 4 2011
8505090 Archive of text captures from rendered documents 3 2012
9268852 Search engines and systems with handheld document data capture devices 0 2012
8799099 Processing techniques for text capture from a rendered document 0 2012
8781228 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 2 2012
9275051 Automatic modification of web pages 0 2012
8831365 Capturing text from rendered documents using supplement information 1 2013
9075779 Performing actions based on capturing information from rendered documents, such as documents under copyright 1 2013
9143638 Data capture from rendered documents using handheld device 3 2013
8953886 Method and system for character recognition 3 2013
9030699 Association of a portable scanner with input/output and storage devices 0 2013
9116890 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 2 2014
9514134 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 0 2015
9633013 Triggering actions in response to optically or acoustically capturing keywords from a rendered document 0 2016
 
XTREME INTERACTIONS INC. (1)
9601113 System, device and method for processing interlaced multimodal user input 0 2013
 
ROVI GUIDES, INC. (1)
9674563 Systems and methods for recommending content 0 2013
 
SONY INTERACTIVE ENTERTAINMENT EUROPE LIMITED (1)
* 2012/0166,969 APPARATUS AND METHOD OF DATA TRANSFER 1 2008
 
OMRON CORPORATION and STANFORD UNIVERSITY (1)
* 2006/0282,493 Apparatus and method for socially intelligent virtual entity 5 2005
 
OUTLAND RESEARCH, LLC (1)
* 2006/0282,317 METHODS AND APPARATUS FOR CONVERSATIONAL ADVERTISING 29 2006
 
Extempo Systems, Inc. (1)
* 2002/0054,072 System, method, and device for an interactive messenger 12 2000
 
OSRAM SYLVANIA INC. (2)
* 9301372 Light control method and lighting device using the same 1 2011
* 2013/0120,238 LIGHT CONTROL METHOD AND LIGHTING DEVICE USING THE SAME 11 2011
 
LEIDOS, INC. (1)
7386799 Cinematic techniques in avatar-centric communication during a multi-user online simulation 197 2003
 
TATA CONSULTANCY SERVICES LIMITED (1)
* 2013/0167,025 SYSTEM AND METHOD FOR ONLINE USER ASSISTANCE 0 2012
 
ZHIGU HOLDINGS LIMITED (2)
8635637 User interface presenting an animated avatar performing a media reaction 14 2011
9154837 User interface presenting an animated avatar performing a media reaction 3 2013
 
MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD. (2)
* 7002584 Video information producing device 1 2001
* 2004/0027,353 Video information producing device 1 2003
 
STEVEN M. HOFFBERG 2004-1 GRAT (2)
8892495 Adaptive pattern recognition based controller apparatus and method and human-interface therefore 1 2013
9535563 Internet appliance system and method 0 2013
 
AT&T CORP. (1)
* 6941269 Method and system for providing automated audible backchannel responses 17 2001
* Cited By Examiner