US Patent No: 8,179,393

Number of patents in Portfolio can not be more than 2000

Fusion of a 2D electro-optical image and 3D point cloud data for scene interpretation and registration performance assessment

Stats

ALSO PUBLISHED AS: 20100207936
ATTORNEY / AGENT: (SPONSORED)
 

Importance

Loading Importance Indicators... loading....

Abstract

Method and system for combining a 2D image with a 3D point cloud for improved visualization of a common scene as well as interpretation of the success of the registration process. The resulting fused data contains the combined information from the original 3D point cloud and the information from the 2D image. The original 3D point cloud data is color coded in accordance with a color map tagging process. By fusing data from different sensors, the resulting scene has several useful attributes relating to battle space awareness, target identification, change detection within a rendered scene, and determination of registration success.

Loading the Abstract Image... loading....

First Claim

Related Publications

Loading Related Publications... loading....

Patent Owner(s)

Patent OwnerAddressTotal Patents
HARRIS CORPORATIONMELBOURNE, FL1833

International Classification(s)

  • [Classification Symbol]
  • [Patents Count]

Inventor(s)

Inventor Name Address # of filed Patents Total Citations
Minear, Kathleen - 20 42
Pooley, Donald - 2 2
Smith, Anthony O'Neil Gainesville, FL 27 55

Cited Art

Patent Info (Count) # Cites Year
 
HARRIS CORPORATION (10)
2009/0231,327 METHOD FOR VISUALIZATION OF POINT CLOUD DATA 3 2008
2009/0232,355 REGISTRATION OF 3D POINT CLOUD DATA USING EIGENANALYSIS 3 2008
2009/0232,388 REGISTRATION OF 3D POINT CLOUD DATA BY CREATION OF FILTERED DENSITY IMAGES 5 2008
2010/0086,220 IMAGE REGISTRATION USING ROTATION TOLERANT CORRELATION METHOD 2 2008
2010/0118,053 GEOSPATIAL MODELING SYSTEM FOR IMAGES AND RELATED METHODS 4 2008
2010/0207,936 FUSION OF A 2D ELECTRO-OPTICAL IMAGE AND 3D POINT CLOUD DATA FOR SCENE INTERPRETATION AND REGISTRATION PERFORMANCE ASSESSMENT 2 2009
2010/0208,981 Method for visualization of point cloud data based on scene content 2 2009
2010/0209,013 REGISTRATION OF 3D POINT CLOUD DATA TO 2D ELECTRO-OPTICAL IMAGE DATA 3 2009
2011/0115,812 METHOD FOR COLORIZATION OF POINT CLOUD DATA BASED ON RADIOMETRIC IMAGERY 1 2009
2011/0200,249 SURFACE DETECTION IN IMAGES BASED ON SPATIAL DATA 2 2010
 
LEICA GEOSYSTEMS AG (8)
5,988,862 Integrated system for quickly and accurately imaging and modeling three dimensional objects 165 1996
6,246,468 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 96 1998
6,330,523 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 87 1998
6,420,698 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 55 1998
6,473,079 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 30 1998
6,512,993 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 41 2001
6,512,518 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 34 2002
7,990,397 Image-mapped point cloud with ability to accurately represent point coordinates 4 2007
 
DELTASPHERE, INC. (4)
7,477,360 Method and apparatus for displaying a 2D image data set combined with a 3D rangefinder data set 8 2006
7,777,761 Method and apparatus for specifying and displaying measurements within a 3D rangefinder data set 5 2006
7,974,461 Method and apparatus for displaying a calculated geometric entity within one or more 3D rangefinder data sets 5 2006
2006/0244,746 Method and apparatus for displaying a 2D image data set combined with a 3D rangefinder data set 11 2006
 
HONEYWELL INTERNATIONAL INC. (2)
5,781,146 Automatic horizontal and vertical scanning radar with terrain display 36 1996
7,098,809 Display methodology for encoding simultaneous absolute and relative altitude terrain data 11 2003
 
MICROSOFT CORPORATION (2)
5,875,108 Ergonomic man-machine interface incorporating adaptive pattern recognition based control system 350 1995
6,476,803 Object modeling system and process employing noise elimination and robust surface extraction techniques 31 2000
 
SARNOFF CORPORATION (2)
7,242,460 Method and apparatus for automatic registration and visualization of occluded targets using ladar data 9 2004
2006/0061,566 Method and apparatus for performing three-dimensional computer modeling 13 2005
 
AEROTEC, LLC (1)
7,046,841 Method and system for direct classification from three dimensional digital imaging 22 2003
 
AMERICAN VEHICULAR SCIENCES LLC (1)
6,526,352 Method and arrangement for mapping a road 152 2001
 
BAYLOR COLLEGE OF MEDICINE (1)
2004/0114,800 System and method for image segmentation 24 2003
 
CARNEGIE MELLON UNIVERSITY (1)
2007/0280,528 System and method for generating a terrain model for autonomous navigation in vegetation 7 2006
 
CLARON TECHNOLOGY INC. (1)
2009/0097,722 METHOD, SYSTEM AND SOFTWARE PRODUCT FOR PROVIDING EFFICIENT REGISTRATION OF VOLUMETRIC IMAGES 3 2007
 
FOSTER-MILLER TECHNOLOGIES, INC. (1)
2005/0171,456 Foot pressure and shear data visualization system 9 2004
 
HEWLETT-PACKARD DEVELOPMENT COMPANY, L.P. (1)
7,831,087 Method for visual-based recognition of an object 6 2003
 
HONDA GIKEN KOGYO KABUSHIKI KAISHA (1)
5,247,587 Peak data extracting device and a rotary motion recurrence formula computing device 9 1992
 
IHS GLOBAL INC. (1)
2009/0225,073 Method for Editing Gridded Surfaces 3 2008
 
INTELLIGENT TECHNOLOGIES INTERNATIONAL, INC. (1)
6,405,132 Accident avoidance system 305 2000
 
LIMBIC SYSTEMS, INC. (1)
2002/0176,619 Systems and methods for analyzing two-dimensional images 7 2002
 
LUMENIQ, INC. (1)
2004/0109,608 Systems and methods for analyzing two-dimensional images 10 2003
 
MITSUBISHI DENKI KABUSHIKI KAISHA (1)
7,015,931 Method and apparatus for representing and searching for color images 10 2000
 
NIPPON TELEGRAPH AND TELEPHONE CORPORATION (1)
6,904,163 Tomographic image reading method, automatic alignment method, apparatus and computer readable medium 17 2000
 
SILICON VALLEY BANK (1)
5,416,848 Method and apparatus for manipulating colors or patterns using fractal or geometric methods 27 1992
 
SYSTEM ANALYZING TECHNOLOGIES, INC. (1)
6,206,691 System and methods for analyzing tooth shades 24 1999
 
UTAH STATE UNIVERSITY (1)
7,940,279 System and method for rendering of texel imagery 4 2008
 
VANDERBILT UNIVERSITY (1)
7,647,087 Apparatus and methods of cortical surface registration and deformation tracking for patient-to-image alignment in relation to image-guided surgery 5 2006
 
OTHER [CHECK PATENT PROFILE FOR ASSIGNMENT INFORMATION] (8)
5,901,246 Ergonomic man-machine interface incorporating adaptive pattern recognition based control system 226 1995
6,081,750 Ergonomic man-machine interface incorporating adaptive pattern recognition based control system 225 1995
6,271,860 Method and system for display of an additional dimension 16 1998
6,400,996 Adaptive pattern recognition based control system and method 589 1999
6,418,424 Ergonomic man-machine interface incorporating adaptive pattern recognition based control system 201 1999
2002/0149,585 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 18 2002
2003/0001,835 Integrated system for quickly and accurately imaging and modeling three-dimensional objects 19 2002
7,130,490 Attentive panoramic visual sensor 8 2002

Patent Citation Ranking

Forward Cites

  • No Forward Cites to Display

Maintenance Fees

Fee Large entity fee small entity fee micro entity fee due date
3.5 Year Payment $1600.00 $800.00 $400.00 Nov 15, 2015
7.5 Year Payment $3600.00 $1800.00 $900.00 Nov 15, 2019
11.5 Year Payment $7400.00 $3700.00 $1850.00 Nov 15, 2023
Fee Large entity fee small entity fee micro entity fee
Surcharge - 3.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 7.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge - 11.5 year - Late payment within 6 months $160.00 $80.00 $40.00
Surcharge after expiration - Late payment is unavoidable $700.00 $350.00 $175.00
Surcharge after expiration - Late payment is unintentional $1,640.00 $820.00 $410.00