IP Library Granted Patent US 7,129,887
Granted Patent B2
US 7,129,887 · App. 10/824,410 · Granted Oct 31, 2006

Augmented reality traffic control center

Assignee: Lockheed Martin MS2
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,129,887
App. No.
10/824,410
Granted
Oct 31, 2006
Kind
B2
Abstract

In an exemplary embodiment, an augmented reality system for traffic control combines data from a plurality of sensors to display, in real time, information about traffic control objects, such as airplanes. The sensors collect data, such as infrared, ultraviolet, and acoustic data. The collected data is weather-independent due to the combination of different sensors. The traffic control objects and their associated data are then displayed visually to the controller regardless of external viewing conditions. The system also responds to the controller's physical gestures or voice commands to select a particular traffic control object for close-up observation or to open a communication channel with the particular traffic control object.

Claims (36)

1. A augmented reality system, comprising:

a display for use by an air traffic controller in an operations center on a water-based craft;

a sensor for collecting data associated with air traffic control objects in a traffic control space;

a computer receiving said data from said sensor, and operative to display said data on said display to the air traffic controller in the operations center in real time; and

means for detecting a physical gesture of the air traffic controller in the operations center selecting an traffic control object displayed on said display of the air traffic controller.

2. The system of claim 1 , further comprising means for displaying flight data about said air traffic control objects on said display.

3. The system of claim 2 , wherein said flight data comprises at least one of a trajectory, heading, altitude, speed, call sign, and/or flight number.

4. The system of claim 1 , further comprising means for opening a communication channel to said selected air traffic control object.

5. The system of claim 1 , wherein said display comprises a plurality of displays arranged to simulate a plurality of windows in an air craft carrier primary flight (PriFly) control tower.

6. The system of claim 1 , further comprising:

means for opening a computer data file containing data about said selected air traffic control object; and

means for displaying said data as a textual annotation on said display.

7. The system of claim 6 , wherein said data about said selected air traffic control object comprises at least one of: a passenger list or a physical characteristic of said selected air traffic control object.

8. The system of claim 1 , wherein said physical gesture to be detected comprises at least one of a hand gesture, a pointing gesture, a voice command, a sustained visual look, and/or a change of visual focus.

9. The system of claim 1 , wherein said sensor comprises at least one of an infrared image sensor, a radio frequency image sensor, RADAR, LIDAR, a millimeter wave imaging sensor, an acoustic sensor, a digital infrared camera, a digital ultraviolet camera, an electro-optical camera, digital RADAR, and/or high-resolution radar.

10. The system of claim 1 , wherein said display comprises a virtual reality helmet.

11. The system of claim 1 , wherein said traffic control space is an aircraft carrier air traffic control space.

12. The system of claim 1 , wherein said means for detecting comprise a laser pointer, a gyro-mouse, a video observation system, a data glove, a touch-sensitive screen, and/or a voice observation system.

13. The system of claim 1 , wherein said data collected by said sensor comprises non-visual data.

14. The system of claim 1 , wherein the water-based craft is an aircraft carrier.

15. A method, comprising:

(a) collecting data associated with air traffic control objects in an air traffic control space;

(b) displaying said data to an air traffic controller in an operation center on a water-based craft in real time; and

(c) detecting a physical gesture of the traffic controller selecting one of said air traffic control objects displayed.

16. The method of claim 15 , further comprising:

(d) opening a communication channel with said selected air traffic control object.

17. The method of claim 15 , further comprising:

(d) displaying flight data about said air traffic control objects.

18. The method of claim 17 , wherein (d) comprises displaying at least one of a trajectory, heading, altitude, speed, call sign, and/or flight number.

19. The method of claim 15 , further comprising:

opening a computer data file containing data about said selected air traffic control object; and

displaying said data as a textual annotation on said display.

20. The method of claim 15 , wherein (a) comprises collecting said data from at least one of an infrared image sensor, a radio frequency image sensor, RADAR, LIDAR, a millimeter wave imaging sensor, an acoustic sensor, a digital infrared camera, a digital ultraviolet camera, digital RADAR, and electro-optical camera, and/or high-resolution radar.

21. The method of claim 15 , wherein (c) comprises detecting at least one of a hand gesture, a pointing gesture, a voice command, a sustained visual look, and/or a change of visual focus.

22. The method of claim 15 , wherein (b) comprises displaying said data on at least one of a plurality of displays arranged to simulate a plurality of windows in a flight control tower, and/or a virtual reality helmet.

23. The method of claim 15 , wherein (a) comprises collecting non-visual data associated with traffic control objects in the traffic control space.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 4, 2007
From: MITCHELL, STEVEN W.
To: LOCKHEED MARTIN CORPORATION
Reel/Frame 018708/0678 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2004
From: MITCHELL, STEVEN W.
To: LOCKHEED MARTIN MS2
Reel/Frame 015224/0978 →
Continuity (1)
Related Publication 20050231419A1 · Oct 20, 2005