IP Library Granted Patent US 10,032,311
Granted Patent B1
US 10,032,311 · App. 14/499,907 · Granted Jul 24, 2018

Synthetic image enhancing system, device, and method

Inventors: Max G. Taylor (Hiawatha, IA); Scott E. Schultz (Cedar Rapids, IA); Matthew J. Cunnien (Marion, IA); Michael J. Armstrong (Central City, IA); Ryan J. Olson (Marion, IA); Peter J. Flugstad (Marion, IA); Shawn M. Spencer (Cedar Rapids, IA)
Assignee: Rockwell Collins, Inc.
G06T19/006G01C21/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,032,311
App. No.
14/499,907
Granted
Jul 24, 2018
Kind
B1
Abstract

Present novel and non-trivial system, device, and method for enhancing a three-dimensional synthetic image are disclosed. The image generating system is comprised of a first image data source, a second image data source, an image processing unit (“IPU”), and a display system. The IPU may be configured to receive first image data of a first image of a first external scene produced from object data; receive second image data of a second image of a second external scene produced from point cloud data acquired by one or more image capturing devices or object data augmented with point cloud data; combine the first image data with the second image data to produce third image data of a third image of the first external scene; and provide the third image data set to the display system. Fourth image data could be received and included in the production of the three image data.

Claims (45)

1. A system for enhancing an aircraft synthetic vision system (SVS) image presentable to a viewer, comprising:

first image data representative of a first viewable aircraft SVS image of an external scene produced from at least terrain data acquired from an object data source;

second image data representative of a viewable point cloud image of the external scene produced from at least one image capturing device;

third image data representative of a second viewable aircraft SVS image of the external scene produced from the at least terrain data augmented with the viewable point cloud data acquired by the at least one image capturing device; and

an image processing unit configured to:

receive the first, second, and third image data; and

combine the first, second, and third image data to produce fourth image data representative of a fourth image of the external scene presentable to a viewer, such that

the fourth image includes an inset depicting the second viewable aircraft SVS image placed within the first viewable aircraft SVS image and overlaid by the viewable point cloud image.

2. The system of claim 1 , wherein the viewable point cloud image includes a plurality of colors corresponding to at least one of a height color map, a range color map, and a landing suitability color map.

3. The system of claim 2 , wherein the landing suitability color map is based upon a roughness analysis, a slope analysis, or a combination of both analyses.

4. The system of claim 1 , wherein

the viewable point cloud image is comprised of at least one highlighter of a plurality of highlighters, where

a first highlighter highlights at least one non-terrain object acquired by a point cloud system that is not represented in the object data from which the first image data is produced,

a second highlighter highlights at least a part of an area currently being scanned by the at least one image capturing device,

a third highlighter highlights at least a part of the second viewable aircraft SVS image, and

a fourth highlighter highlights at least one sensor viewing frustum.

5. A device for enhancing an aircraft synthetic vision system (SVS) image presentable to a viewer, comprising:

an image processing unit configured to:

receive first image data representative of a first viewable aircraft SVS image of an external scene produced from at least terrain data acquired from an object data source;

receive second image data representative of a viewable point cloud image of the external scene produced from at least one image capturing device;

receive third image data representative of a second viewable aircraft SVS image of the external scene produced from the object data augmented with the viewable point cloud data acquired by the at least one image capturing device; and

combine the first, second, and third image data to produce fourth image data representative of a fourth image of the external scene presentable to a viewer, such that

the fourth image includes an inset depicting the second viewable aircraft SVS image placed within the first viewable aircraft SVS image and overlaid by the viewable point cloud image.

6. The device of claim 5 , wherein the viewable point cloud image includes a plurality of colors corresponding to at least one of a height color map, a range color map, and a landing suitability color map.

7. The device of claim 5 , wherein the landing suitability color map is based upon a roughness analysis, a slope analysis, or a combination of both analyses.

8. The device of claim 5 , wherein

the viewable point cloud image is comprised of at least one highlighter of a plurality of highlighters, where

a first highlighter highlights at least one non-terrain object acquired by a point cloud system that is not represented in the object data from which the first image data is produced,

a second highlighter highlights at least a part of an area currently being scanned by the at least one image capturing device,

a third highlighter highlights at least a part of the second viewable aircraft SVS image, and

a fourth highlighter highlights at least one sensor viewing frustum.

9. A method for enhancing an aircraft synthetic vision system (SVS) image presentable to a viewer, comprising:

receiving first image data representative of a first viewable aircraft SVS image of an external scene produced from at least terrain data acquired from an object data source;

receiving second image data representative of a viewable point cloud image of the external scene produced from at least one image capturing device;

receiving third image data representative of a second viewable aircraft SVS image of the external scene produced from the object data augmented with the viewable point cloud data acquired by the at least one image capturing device; and

combining the first, second, and third image data to produce fourth image data representative of a fourth image of the external scene presentable to a viewer, such that

the fourth image includes an inset depicting the second viewable aircraft SVS image placed within the first viewable aircraft SVS image and overlaid by the viewable point cloud image.

10. The method of claim 9 , wherein the viewable point cloud image includes a plurality of colors corresponding to at least one of a height color map, a range color map, and a landing suitability color map.

11. The method of claim 9 , wherein the landing suitability color map is based upon a roughness analysis, a slope analysis, or a combination of both analyses.

12. The method of claim 9 , wherein

the viewable point cloud image is comprised of at least one highlighter of a plurality of highlighters, where

a first highlighter highlights at least one non-terrain object acquired by a point cloud system that is not represented in the object data from which the first image data is produced,

a second highlighter highlights at least a part of an area currently being scanned by the at least one image capturing device,

a third highlighter highlights at least a part of the second viewable aircraft SVS image, and

a fourth highlighter highlights at least one sensor viewing frustum.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2014
From: TAYLOR, MAX G.; SCHULTZ, SCOTT E.; CUNNIEN, MATTHEW J.; ARMSTRONG, MICHAEL J.; OLSON, RYAN J.; FLUGSTAD, PETER J.; SPENCER, SHAWN M.
To: ROCKWELL COLLINS, INC.
Reel/Frame 033840/0538 →
Cited By (1)
US 12,315,245