IP Library › Granted Patent US 12,455,140
Granted Patent B2
US 12,455,140 · App. 18/612,519 · Granted Oct 28, 2025

System and method for video image registration and/or providing supplemental data in a heads up display

Inventors: John Richard Scales (Huntsville, AL); Michael Harris Rodgers (Huntsville, AL); Mark D. Hose (Huntsville, AL)
Assignee: Science Applications International Corporation
F41G3/165G02B27/017G02B27/0172G02B27/0176G02B27/0189G06T7/20G06T7/32G06T19/006G06V10/751H04N5/265H04N23/90G02B2027/0134G02B2027/0138G02B2027/014G02B2027/0159G02B2027/0178G06T2207/10016G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,455,140
App. No.
18/612,519
Granted
Oct 28, 2025
Kind
B2
Abstract

Video sources and inertial sensors are attached to a weapon and to goggles. A computer receives video images from the weapon- and goggles-mounted sources and inertial data from the sensors. The computer calculates a location for an image from the weapon-mounted source within an image from the goggles-mounted source using the inertial sensor data. The sensor-based location is checked (and possibly adjusted) based on a comparison of the images. A database contains information about real-world objects in a field of view of the goggles-mounted source, and is used to generate icons or other graphics concerning such objects.

Claims (67)

1. A method comprising:

selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;

determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:

a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and

a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;

determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and

generating a modified version of the third image comprising the portion of the fourth image in the determined position.

2. The method of claim 1 , wherein the first sensor data and the third sensor data comprise data from an inertial measurement unit (IMU) sensor coupled to the first video source, and wherein the second sensor data and the fourth sensor data comprise data from an IMU sensor coupled to the second video source.

3. The method of claim 1 , wherein the comparing the image data for the portion of the first image to the image data for the portion of the second image comprises determining whether points of the first image and of the second image represent a same part of an external environment.

4. The method of claim 1 , wherein the comparing the image data for the portion of the first image to the image data for the portion of the second image comprises determining a rotation of the portion of the second image relative to the portion of the first image.

5. A method comprising:

selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;

determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment;

determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source;

generating a modified version of the third image comprising the portion of the fourth image in the determined position;

receiving, while a first field of view (FOV) of a Heads-Up Display (HUD) associated with the first video source does not overlap with a second FOV associated with the second video source, video data from the first video source comprising a fifth image and video data from the second video source comprising a sixth image; and

generating a modified version of the fifth image comprising a portion of the sixth image.

6. The method of claim 1 , further comprising wirelessly receiving data from the second video source.

7. The method of claim 1 , wherein the first video source is mounted to a helmet and the second video source is mounted to a weapon.

8. The method of claim 5 , wherein the first video source is mounted to a helmet and the second video source is mounted to a weapon.

9. A method comprising:

selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;

determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:

a rotation, for a region of the second image that comprises the portion of the second

image, determined using the first sensor data and the second sensor data, and a rotation, for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;

determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and

generating a modified version of the third image comprising the portion of the fourth image in the determined position.

10. A system comprising:

a processor; and

a memory having instructions stored thereon, that, when executed by the processor, cause the processor to perform operations, the operations comprising:

selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;

determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:

a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and

a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;

determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and

generating a modified version of the third image comprising the portion of the fourth image in the determined position.

11. The system of claim 10 , wherein the comparing the image data for the portion of the first image to the image data for the portion of the second image comprises determining whether points of the first image and of the second image represent a same part of an external environment.

12. The system of claim 10 , wherein the comparing the image data for the portion of the first image to the image data for the portion of the second image comprises determining a rotation of the portion of the second image relative to the portion of the first image.

13. The system of claim 10 , wherein the first video source is mounted to a helmet and the second video source is mounted to a weapon.

14. The method of claim 9 , wherein the first video source is mounted to a helmet and the second video source is mounted to a weapon.

15. A system comprising:

a processor; and

a memory having instructions stored thereon, that, when executed by the processor, cause the processor to perform operations, the operations comprising:

selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;

determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:

a rotation, for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and

a rotation, for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;

determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and

generating a modified version of the third image comprising the portion of the fourth image in the determined position.

16. A non-transitory machine-readable medium having machine executable instructions for performing a method comprising:

selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;

determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:

a position, in the first image for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and

a position, in the first image for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;

determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and

generating a modified version of the third image comprising the portion of the fourth image in the determined position.

17. The non-transitory machine-readable medium of claim 16 , wherein the comparing the image data for the portion of the first image to the image data for the portion of the second image comprises determining whether points of the first image and of the second image represent a same part of an external environment.

18. The non-transitory machine-readable medium of claim 16 , wherein the comparing the image data for the portion of the first image to the image data for the portion of the second image comprises determining a rotation of the portion of the second image relative to the portion of the first image.

19. The system of claim 15 , wherein the first video source is mounted to a helmet and the second video source is mounted to a weapon.

20. A non-transitory machine-readable medium having machine executable instructions for performing a method comprising:

selecting, based on first sensor data indicating motion of a first video source and based on second sensor data indicating motion of a second video source, a portion of a first image, from the first video source, corresponding to a portion of a second image from the second video source;

determining, based on comparing image data for the portion of the first image to image data for the portion of the second image, a motion data adjustment, wherein the motion data adjustment indicates a difference between:

a rotation, for a region of the second image that comprises the portion of the second image, determined using the first sensor data and the second sensor data, and

a rotation, for the region of the second image, determined by comparing the image data for the portion of the first image to the image data for the portion of the second image;

determining, based on the motion data adjustment, based on third sensor data indicating motion of the first video source, and based on fourth sensor data indicating motion of the second video source, a position in a third image, from the first video source, for a portion of a fourth image from the second video source; and

generating a modified version of the third image comprising the portion of the fourth image in the determined position.

21. The non-transitory machine-readable medium of claim 20 , wherein the first video source is mounted to a helmet and the second video source is mounted to a weapon.

Assignments (4)
SECURITY INTEREST Recorded Dec 10, 2025
From: SCIENCE APPLICATIONS INTERNATIONAL CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073170/0273 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2024
From: SCALES, JOHN RICHARD; RODGERS, MICHAEL HARRIS; HOSE, MARK D.
To: SCIENCE APPLICATIONS INTERNATIONAL CORPORATION
Reel/Frame 066871/0609 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2024
From: SCIENCE APPLICATIONS INTERNATIONAL CORPORATION
To: SAIC GEMINI, INC.
Reel/Frame 066871/0624 →
CHANGE OF NAME Recorded Mar 22, 2024
From: SAIC GEMINI, INC.
To: SCIENCE APPLICATIONS INTERNATIONAL CORPORATION
Reel/Frame 066877/0243 →
Continuity (6)
Continuation 17723730 · Apr 19, 2022
Continuation 16165210 · Oct 19, 2018
Continuation 15483086 · Apr 10, 2017
Continuation 14950643 · Nov 24, 2015
Continuation 11680207 · Feb 28, 2007
Related Publication 20240230279A1 · Jul 11, 2024
References Cited (344)
US 3674925A · Heckman, Jr. · 1972 [cited by applicant]
US 3798795A · Michelsen · 1974 [cited by applicant]
US 3798796A · Stauff et al. · 1974 [cited by applicant]
US 3843969A · George et al. · 1974 [cited by applicant]
US 3964178A · Marshall et al. · 1976 [cited by applicant]
US 4020324A · Buscher et al. · 1977 [cited by applicant]
US 4028725A · Lewis · 1977 [cited by applicant]
US 4081716A · Uemura · 1978 [cited by applicant]
US 4091412A · Salonimer · 1978 [cited by applicant]
US 4222880A · Baur et al. · 1980 [cited by applicant]
US 4280125A · Kazan · 1981 [cited by applicant]
US 4290757A · Marshall et al. · 1981 [cited by applicant]
US 4302191A · Weibull · 1981 [cited by applicant]
US 4398799A · Swift · 1983 [cited by applicant]
US 4470817A · Diehl et al. · 1984 [cited by applicant]
US 4516157A · Campbell · 1985 [cited by applicant]
US 4597740A · Stickel · 1986 [cited by applicant]
US 4605959A · Colbaugh · 1986 [cited by applicant]
US 4703879A · Kastendieck et al. · 1987 [cited by applicant]
US 4752824A · Moore · 1988 [cited by applicant]
US 4786966A · Hanson et al. · 1988 [cited by applicant]
US 4884137A · Hanson et al. · 1989 [cited by applicant]
US 4923401A · Marshall et al. · 1990 [cited by applicant]
US 4963006A · Inadome · 1990 [cited by applicant]
US 4970589A · Hanson et al. · 1990 [cited by applicant]
US 5005213A · Hanson et al. · 1991 [cited by applicant]
US 5059781A · Langdon · 1991 [cited by applicant]
US 5200827A · Hanson et al. · 1993 [cited by applicant]
US 5274236A · Pascale et al. · 1993 [cited by applicant]
US 5281142A · Zaenglein, Jr. · 1994 [cited by applicant]
US 5325449A · Burt et al. · 1994 [cited by applicant]
US 5353134A · Michel et al. · 1994 [cited by applicant]
US 5488674A · Burt et al. · 1996 [cited by applicant]
US 5555324A · Waxman et al. · 1996 [cited by applicant]
US 5625765A · Ellenby et al. · 1997 [cited by applicant]
US 5675112A · Giry et al. · 1997 [cited by applicant]
US 5701202A · Takahashi · 1997 [cited by applicant]
US 5711104A · Schmitz · 1998 [cited by applicant]
US 5806229A · Daz et al. · 1998 [cited by applicant]
US 5834676A · Elliott · 1998 [cited by applicant]
US 5864481A · Gross et al. · 1999 [cited by applicant]
US 5991043A · Andersson et al. · 1999 [cited by applicant]
US 6123006A · Bedford, Jr. et al. · 2000 [cited by applicant]
US 6181302B1 · Lynde · 2001 [cited by applicant]
US 6237462B1 · Hawkes et al. · 2001 [cited by applicant]
US 6292593B1 · Nako et al. · 2001 [cited by applicant]
US 6449419B1 · Brough et al. · 2002 [cited by applicant]
US 6560029B1 · Dobbie et al. · 2003 [cited by applicant]
US 6707761B2 · Erikson · 2004 [cited by applicant]
US 6765569B2 · Neumann et al. · 2004 [cited by applicant]
US 6781127B1 · Wolff et al. · 2004 [cited by applicant]
US 6785404B1 · Shimazaki et al. · 2004 [cited by applicant]
US 6826295B2 · Lichtermann et al. · 2004 [cited by applicant]
US 6836320B2 · Deflumere et al. · 2004 [cited by applicant]
US 6899539B1 · Stallman et al. · 2005 [cited by applicant]
US 6963800B1 · Milbert · 2005 [cited by applicant]
US 7002551B2 · Azuma et al. · 2006 [cited by applicant]
US 7037258B2 · Chatenever et al. · 2006 [cited by applicant]
US 7050078B2 · Dempski · 2006 [cited by applicant]
US 7277118B2 · Foote · 2007 [cited by applicant]
US 7365706B2 · Shimoyama et al. · 2008 [cited by applicant]
US 7369174B2 · Olita et al. · 2008 [cited by applicant]
US 7401920B1 · Kranz et al. · 2008 [cited by applicant]
US 7580185B2 · Haisch et al. · 2009 [cited by applicant]
US 7620265B1 · Wolff et al. · 2009 [cited by applicant]
US 7786424B2 · Durner et al. · 2010 [cited by applicant]
US 7787012B2 · Scales et al. · 2010 [cited by applicant]
US 7805020B2 · Trudeau et al. · 2010 [cited by applicant]
US 7810273B2 · Koch et al. · 2010 [cited by applicant]
US 7832137B2 · Sammut et al. · 2010 [cited by applicant]
US 8587659B1 · Socolinsky et al. · 2013 [cited by applicant]
US 8817103B2 · Scales et al. · 2014 [cited by applicant]
US 9229230B2 · Scales et al. · 2016 [cited by applicant]
US 9618752B2 · Scales et al. · 2017 [cited by applicant]
US 20020015536A1 · Warren et al. · 2002 [cited by applicant]
US 20030210228A1 · Ebersole et al. · 2003 [cited by applicant]
US 20040051680A1 · Azuma et al. · 2004 [cited by applicant]
US 20040056870A1 · Shimoyama et al. · 2004 [cited by applicant]
US 20040257441A1 · Pevear et al. · 2004 [cited by applicant]
US 20050073531A1 · Kuroki et al. · 2005 [cited by applicant]
US 20050179799A1 · Umanskiy et al. · 2005 [cited by applicant]
US 20050207651A1 · Yang et al. · 2005 [cited by applicant]
US 20060055786A1 · Ollila · 2006 [cited by applicant]
US 20060116814A1 · Milbert · 2006 [cited by applicant]
US 20060121993A1 · Scales et al. · 2006 [cited by applicant]
US 20070001874A1 · Feyereisen et al. · 2007 [cited by applicant]
US 20080025640A1 · Trudeau et al. · 2008 [cited by applicant]
US 20080048931A1 · Ben-Ari · 2008 [cited by applicant]
US 20090040308A1 · Temovskiy · 2009 [cited by applicant]
US 20090235570A1 · Sammut et al. · 2009 [cited by applicant]
US 20100254572A1 · Tener et al. · 2010 [cited by applicant]
US 20100258000A1 · Hagerty · 2010 [cited by applicant]
CN 1624414A · 2005 [cited by applicant]
CN 1727836A · 2006 [cited by applicant]
DE 2436169A1 · 1976 [cited by applicant]
EP 0545527B1 · 1996 [cited by applicant]
EP 0777100A2 · 1997 [cited by applicant]
KR 20040091992A · 2004 [cited by applicant]
WO 8802841A1 · 1988 [cited by applicant]
WO 9012330A3 · 1990 [cited by applicant]
WO 9319414A1 · 1993 [cited by applicant]
WO 9516948A1 · 1995 [cited by applicant]
WO 9725583A1 · 1997 [cited by applicant]
WO 9727527A1 · 1997 [cited by applicant]
WO 9851986A1 · 1998 [cited by applicant]
WO 0037875A1 · 2000 [cited by applicant]
WO 04068212A1 · 2004 [cited by applicant]
WO 07107975A1 · 2007 [cited by applicant]
WO 07133620A2 · 2007 [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Order, [cited by applicant]
Plaintiff's Motion for Reconsideration, [cited by applicant]
Defendants' Response in Opposition to SAIC's Rule 59 Motion for Reconsideration, [cited by applicant]
Defendant-Intervenor Microsoft Corporation's Amended Invalidity Contentions for the '230 Patent, [cited by applicant]
Defendants' Jun. 30, 2022, Amended Invalidity Contentions for the '230 Patent, [cited by applicant]
Memorandum Order, [cited by applicant]
Defendant-Intervenor Microsoft Corporation's Motion for Summary Judgment of Invalidity Based on Indefiniteness, [cited by applicant]
Science Applications International Corporation's Memorandum in Support of Its Motion for Partial Summary Judgment of Infringement by the Government and for Summay Judgment Regarding the Desert's Edge Prior Art Status, [cited by applicant]
Defendants' Combined Opposition to SAIC's Motions for Patial Summary Judgement of Infringement by the Government and Prior Art Status of Desert's Edge (ECF 340), [cited by applicant]
Science Applications International Corporation's Opposition to Defendant-Intervenor Microsoft Corporation's and the United States' and Third Party Defendant L3 Technologies, Inc.'s Motions for Summary Judgment of Invali… [cited by applicant]
Science Applications International Corporation's Reply to Defendants' Combined Opposition to SAIC's Motion for Partial Summary Judgment of Infringement by the Government and Prior Art Status of Desert's Edge, [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 012-06 (Valery) U.S. Pat. No. 7,786,012, in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 012-01 (Hanson) U.S. Pat. No. 7,787,012 in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 012-02 (Roberts References) U.S. Pat. No. 7,787,012, in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 103-02 (Roberts References) U.S. Pat. No. 8,817,103, in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 103-06 (Valery) U.S. Pat. No. 8,817,103, in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 230-01 (Dobbie) U.S. Pat. No. 9,229,230, in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 230-02 (Roberts References) U.S. Pat. No. 9,229,230 in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 230-06 (Valery) U.S. Pat. No. 9,229,230 in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 752-01 (Dobbie) U.S. Pat. No. 9,618,752 in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 752-02 (Roberts References) U.S. Pat. No. 9,617,752 in [cited by applicant]
Science Applications International Corporation's Response to Microsoft's Invalidity Contentions Exhibit 752-06 (Valery) U.S. Pat. No. 9,618,752 in [cited by applicant]
Plaintiff's Motion for Reconsideration with Exhibits A, B and C, [cited by applicant]
Plaintiff's Reply in Support of Its Motion for Reconsideration with Exhibit A, [cited by applicant]
Foley, J.D., et al., “Computer Graphics: Principles and Practice,” 2nd Ed., Addison-Wesley, (1990), 1239 pages. [cited by applicant]
Melzer, J.E., et al., “Head-Mounted Displays: Designing for the User.” New York: McGraw-Hill, (1997) (445 pages). [cited by applicant]
File history for U.S. Appl. No. 12/116,843 (U.S. Pat. No. 8,587,659), 183 pages. [cited by applicant]
Declaration of Matthew Turk PHD Regarding U.S. Pat. No. 7,787,012—IPR2019-01311 (Jul. 11, 2019) 87 pages. [cited by applicant]
Curriculum Vitae of Matthew A. Turk, PHD, 22 pages. [cited by applicant]
Identification of Proposed Claim Constructions and Supporting Evidence, No. 1:17-cv-00825-MCW, (Jun. 13, 2019), 28 pages. [cited by applicant]
Heads-up display definition—Dictionary.com (accessed Jun. 19, 2019), 3 pages. [cited by applicant]
Spitzer, Cary R., Digital Avionics Systems and Principles and Practices (2000), 10 pages. [cited by applicant]
Declaration of Ingrid Hsieh-Yee, Ph.D. Jul. 10, 2019, 94 pages. [cited by applicant]
New Oxford American Dictionary (2nd ed. 2005), Parts 1 and 2, 134 pages. [cited by applicant]
Complaint for Patent Infringement, Case No. 1:17-cv-00825-MCW (Fed. Cl. Jun. 19, 2017), Document 1, filed Jun. 19, 2017, 47 pages. [cited by applicant]
Declaration of Ingrid Hsieh-Yee, Ph.D., Jul. 15, 2019, 139 pages. [cited by applicant]
Cochran, William T., et al., “What Is the Fast Fourier Transform?”, Proceedings of the IEEE, vol. 55, No. 10, Oct. 1967, 1664-1674, 11 pages. [cited by applicant]
Dictionary.com, “goggle” definition, Jul. 12, 2019, 7 pages. [cited by applicant]
The New Oxford American Dictionary, Second Edition, (2005), 11 pages. [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 9,229,230, IPR2019-01360, Jul. 23, 2019, 91 pages. [cited by applicant]
Dictionary.com, “calibrate” definition, Jul. 16, 2019, 6 pages. [cited by applicant]
Chisholm, P., “21st Century Helicopter Training,” Military Training Technology (Online Ed.). 11(1), 2006, 5 pages. [cited by applicant]
Elbit Systems, “MiDASH Modular Integrated Display and Sight System for Helicopter Pilots,” (2004), 1 page. [cited by applicant]
U.S. Appl. No. 60/560,968, filed Apr. 12, 2004, 68 pages. [cited by applicant]
Anderson, J., “Integrated Imaging Sensors,” SPIE 2001, vol. 4369, pp. 14-24 (11 pages). [cited by applicant]
Dorheim, M., “VTAS Sight Fielded, Shelved in the 1970s.” Aviation Week and Space Technology, Oct. 23, 1951, (1995) (3 pages). [cited by applicant]
Ehlers M., “Spectral Characteristics Preserving Image Fusion Based on Fourier Domain Filtering,” Proceedings of the SPIE, 5574, Remote Sensing for Environmental Monitoring, GIS Applications, and geology IV, doi: 10.1117… [cited by applicant]
Hale, S. et al., “Pilot Assessment of the AH-64 Helmet-Mounted Display System.” Proceedings of the 5th International Symposium on Aviation Psychology, 1, 307-312, (1989) (8 pages). [cited by applicant]
Stuart, G.W. et al., “Head-up displays and visual attention: Integrating data and theory,” in “Contemporary Issues in Human Factors and Aviation Safety.” Burlington, Vermont: Ashgate Publishing, (2005) (26 pages). [cited by applicant]
Horn et al., “Fused Reflected/Emitted Light Sensors,” Proceedings of the SPIE Infrared Technology and Applications XXVII, vol. 4369, p. 1-13, (2001) (13 pages). [cited by applicant]
Janin, A.L. et al., “Calibration of Head-Mounted Displays for Augmented Reality Applications,” Proceedings of IEEE Virtual Reality Annual International Symposium, doi: 10.1109/VRAIS.1993,380772, (Sep. 18-22, 1993) (10 p… [cited by applicant]
Jennings, S., “An In-Flight Evaluation of Stereoscopic Imagery in Helicopter Cockpits,” SPIE Aerosense, Proceedings of SPIE, 3057, 108-117, (1997) (10 pages). [cited by applicant]
Johnston, R.S. et al., “Development of Commercial Retinal Scanning Display.” Helmet- and Head-Mounted Displays and Symbology Design Requirements II, Proceedings of SPIE, 2465, 2-13 (1995) (12 pages). [cited by applicant]
ProView XL35 & XL50, Dec. 8, 2007 web page for <http://www.rockwellcollins.com/optronics/ProductsAndServices/VisionSystems/HeadMountedDisplays/ProViewXL50/page738.html>, downloaded from The Wayback Machine (1 page). [cited by applicant]
Kalich, M.E. et al., “A Limited Flight Study for Investigating Hyperstereo Vision.” Head- and Helmet-Mounted Displays XII: Design and Applications. In: Brown, R.W. et al. (Eds.), Proceedings of SPIE, 6557, 655701, (2007… [cited by applicant]
Klass, P.J., “Navy Pilots to use Helmet Sight.” Aviation Week and Space Technology, Jan. 31, 37-40 (1972), (6 pages). [cited by applicant]
Lucas, T., “Advances in Helmet-Mounted Displays.” Avionics, June, pp. 20-27, (1994) (8 pages). [cited by applicant]
Marshall, G.F., “Back from the Past. Helmet-Mounted Display,” Proceedings of SPIE, 1116, 2-11, (1989) (12 pages). [cited by applicant]
Merryman, R.K., “Vista Sabre II: Integration of Helmet-Mounted Tracker/Display and High Boresight Missile Seeker into F-15 Aircraft.” Proceedings of SPIE, 2218, 173-184, (1994) (14 pages). [cited by applicant]
Nelson, A.S. et al., “High Resolution Color Flat Panel Head-Mounted Display Design for the Advanced Flat Panel Program.” Proceedings of SPIE, 2218, 7-16, (1996) (10 pages). [cited by applicant]
Nelson, S., “Combat Vehicle Crew Helmet-Mounted Display: Next Generation High-Resolution Head-Mounted Display.” In: Lewandowski, R. et al. (Ed.), Helmet- and Head-Mounted Displays and Symbology Design Requirements, Proc… [cited by applicant]
Proctor, P., “Retinal Displays Portend Synthetic Vision, HUD Advances.” Aviation Week and Space Technology, 15, 58, (1996) (3 pages). [cited by applicant]
Seeman, J. et al., “Advanced Helicopter Pilotage Visual Requirements.” Proceedings of the American Helicopter Society, 48, 233-252, (1992) (22 pages). [cited by applicant]
Zhang, E., Pixel-by-pixel VIS/NIR and LIR sensor fusion system, /www.spiedigitallibrary.org/conference-proceedings-of-spie/4820/0000/Pixel-by-pixel-VISNIR-and-LIR-sensor-fusion-system/10.1117/12.450540 (15 pages). [cited by applicant]
Feb. 13, 2007 web page titled “Land Warrior Integrated Modular Fighting System, USA,” http://www.army-technology.com/projects/land_warrior (downloaded from The Wayback Machine) (3 pages). [cited by applicant]
Qt Auto News, “HUD Technology Keeps Your Eye on the Road.” Auto News, http://www.qtautonews.com/2006/04/25/hud-technology-keeps-your-eye-on-the-road/, (2006) (downloaded from The Wayback Machine) (3 pages). [cited by applicant]
Kauchak, M., “AVCATT-A Enters Low-Rate Initial Production.” T&S 2001, An Armed Forces Journal Global Publication, Winter, 56-57, (2001) (4 pages). [cited by applicant]
21 Century Land Warrior (CLW) Generation II (GEN II) Soldier System ATD System/Design Trade Study Report and associated documentation, prototypes and simulations/assessments, (1994-1995) (Jan. 6, 1995) (96 pages) (MSFT … [cited by applicant]
Marine Corp SBIR Topic N04-155 “Sensor for Simultaneous Movement and Directed Weapons Fire in Day/Low/no-light” (GOV-0002224). [cited by applicant]
“Microsoft Initial Invalidity Contentions for Asserted Patents” (redacted) (May 26, 2020), including claim chart 230-05. [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assetions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
Defendant's Assertions from [cited by applicant]
State, A., et al., “Superior Augmented Reality Registration by Integrating Landmark Tracking and Magnetic Tracking,” SIGGRAPH '96 Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques… [cited by applicant]
Kutulakos, K., et al., “Calibration-Free Augmented Reality,” IEEE Transactions on Visualization and Computer Graphics, vol. 4, No. 1, doi: 10.1109/2945.675647, Jan.-Mar. 1998. [cited by applicant]
Xue, Z., et al., “Concealed Weapon Detection Using Color Image Fusion,” pp. 622-627, IEEE 2003. [cited by applicant]
Toet, A., et al., “Merging Thermal and Visual Images by a Contrast Pyramid,” Optical Engineering, vol. 28, No. 7, pp. 789-792, Jul. 1989. [cited by applicant]
Waxman, A., et al., “Color Night Vision: Opponent Processing in the Fusion of Visible and IR Imagery,” Neural Networks, vol. 10, No. 1, pp. 1-6, 1997. [cited by applicant]
Burt, P., et al., “Enhanced Image Capture Through Fusion,” Proceedings of IEEE 4th International Conference on Computer Vision, pp. 173-182, 1993. [cited by applicant]
Scribner, D., et al., “Infrared Color Vision: An Approach to Sensor Fusion,” Optics and Photonics News, pp. 27-32, Aug. 1998. [cited by applicant]
Socolinsky, D., et al., “Multispectral Image Visualization Through First-Order Fusion,” IEEE Transactions on Image Processing, vol. 11, No. 8, pp. 923-931, Aug. 2002. [cited by applicant]
Toet, A., et al., “New False Color Mapping for Image Fusion,” Optical Engineering, vol. 35, No. 3, pp. 650-658, Mar. 1996. [cited by applicant]
Bimber, O., et al., “Spatial Augmented Reality, Merging Real and Virtual Worlds,” AK Peters, Ltd., 2004-2005. [cited by applicant]
Socolinsky, D., et al., “Brain Imaging Registration by Correlation of First-Order Geometry,” Proceedings of SPIE, vol. 3661, Event: Medical Imaging, 1999, Part of the SPIE Conference on Image Processing, Feb. 1999. [cited by applicant]
Ferrin, “Headgear System Development for the Dismounted Soldier,” Proceedings of SPIE, vol. 2735, Head-Mounted Displays, Event: Aerospace/Defense Sensing and Controls, Jun. 7, 1996, doi: 10.1117/12.241905. [cited by applicant]
Roberts, B., et al., “Electronic Compass and Vertical-Angle Measurement Sensor: Applications and Benefits to the Soldier System,” Proceedings of SPIE, vol. 3394, Event: Aerospace/Defense Sensing and Controls, 1998, doi:… [cited by applicant]
Belt, R., et al., “Evolution of Helmet Mounted Display Requirements and Honeywell HMD/HMS Systems,” Proceedings of SPIE, vol. 3362, Part of the SPIE Conference on Helmet and Head-Mounted Displays III, doi:10.1117/12.317… [cited by applicant]
Ackerman, J., Application of Augmented Reality to Laparoscopic Surgery, Doctorate Dissertation submitted to the faculty of The University of North Carolina at Chapel Hill, 2002. [cited by applicant]
Bajura, M., “Merging Virtual Objects with the Real World: Seeing Ultrasound Imagery within the Patient,” Computer Graphics, Proceedings of SIGGRAPH, vol. 26, No. 2, pp. 203-210, Jul. 1992. [cited by applicant]
Beal, C., et al., “Helmet-Mounted Displays: Are we Jumping the Gun?,” International Defense Reivew, pp. 69-75, Sep. 1994. [cited by applicant]
Beal, C., et al., “A New Vision: Helmet-Mounted Displays Take Multi-Track Approach,” Jane's International Defense Review, pp. 41-44, Aug. 1997. [cited by applicant]
Behar, I., et al., Visual Survey of Apache Aviators (VISAA), U.S. Army Aeromedical Research Laboratory, Ft. Rucker, Alabama, USAARL Report 9015, Sep. 1990. [cited by applicant]
Braybrook, R., “Looks Can Kill,” Armada International, SciTech Premium Collection, vol. 22, No. 4, p. 44, Aug./Sep. 1998. [cited by applicant]
Bull, G., “Helmet Displays Options—A Routemap,” SPIE vol. 1290, Helmet-Mounted Displays II, 1990. [cited by applicant]
Cameron, A., et al., “The Viper HMD—from Design Conept to Flight Test,” SPIE, vol. 2218, Helmets Group, Display Systems (Rochester), Displays Division, 1994. [cited by applicant]
Casey, C., et al., “Part-Task Training with a Helmet Integrated Display Simulator System,” Proceedings of SPIE, vol. 1456, Large Screen Projection, Avionic, and Helmet-Mounted Displays, Aug. 1991. [cited by applicant]
Casey, C., “Helmet Mounted Displays on the Modern Battlefield,” Proceedings of SPIE, vol. 3689, Helmet- and Head-Mounted Displays IV, doi: 10.1117/12.352839, Jul. 12, 1999. [cited by applicant]
Chung, J., et al., “Exploring Virtual Worlds with Head-Mounted Displays,” TR89-009, appeared in Non-Holograhic True 3-Dimensional Display Technologies, SPIE Proceedings, vol. 1083, Jan. 15-20, 1989. [cited by applicant]
Davis, L., et al., “Application of Augmented Reality to Visualizing Anatomical Airways,” Helmet- and Head-Mounted Displays VII, Proceedings of SPIE, vol. 4711, pp. 400-405, 2002. [cited by applicant]
Drascic, D., et al., “Perceptual Issues in Augmented Reality,” Proceedings of SPIE, vol. 2653: Stereoscopic Displays and Virtual Reality Systems III< pp. 123-134, Feb. 1996. [cited by applicant]
Duchowski, A., et al., “Binocular Eye Tracking in Virtual Reality for Inspection Training,” Proceedings of the Eye Tracking Research and Applications Symposium, Palm Beach Gardens, FL, pp. 89-96, Nov. 6-8, 2000. [cited by applicant]
Dupont Corporation, “Case Study: Cadillac XLR has a New Generation Head-Up Display (HUD),” <http://www.2.dupont.com/Automotive/en_US/applications/caseStudies/case178.html>, Apr. 20, 2006. [cited by applicant]
Foyle, D., et al., “Attentional Effects with Superimposed Symbology: Implications for Head-Up Displays (HUD),” Proceedings of the Human Factors and Ergonomics Socity 37th Meeting, pp. 1340-1344, 1993. [cited by applicant]
Haar, R., “Virtual Reality in the Military: Present and Future,” Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Jun. 2006. [cited by applicant]
Harding, T., et al., “Optical and Biodynamic Evaluation of the Helmet Integrated Display Sight System (HIDSS) for the RAH-66 Comanche Development and Validation Program Phase,” USAARL Report No. 98-22, U.S. Army Aeromed… [cited by applicant]
Harding, T., et al., Evaluation of the Microvision Helmet-Mounted Display Technology for Synthetic Vision Application Engineering Prototype for the Virtual Cockpit Optimization Program, USAARL Report No. 2004-02, U.S. A… [cited by applicant]
Hiatt, K., et al., “Apache Aviator Visual Experiences with the IHADSS Helmet-Mounted Display in Operation Iraqi Freedom,” USAARL Report No. 2004-20, U.S. Army Aeromedical Research Laboratory, Aug. 2004. [cited by applicant]
Hopper, D., “Reality and Surreality of 3-D Displays: Holodeck and Beyond*,” Invited Keynote Paper in the Electronic Information Display Conference of Society for Information Display, ExCel Conference and Exhibition Cent… [cited by applicant]
Keller, K., et al., “Perception in HMDs, What is it in Head Mounted Displays (HMDs) that really make them all so terrible?,” Proceedings of SPIE, vol. 3362, 46-53, 1998. [cited by applicant]
Manning, S., et al., “A Moveable View, Head-up displays are paving the way for head-worn displays designed to provide information and flight guidance.,” Flight Safety Foundation, Aerosafetyworld, pp. 41-44, Aug. 2007. [cited by applicant]
McCann, R., et al., “Attentional Limitations With Head-Up Displays,” In R.S. Jensen (Ed.), Proceedings of the Seventh International Symposium on Aviation Psychology, 70-75, Columbus: Ohio State University, 1993. [cited by applicant]
McCann, R., et al., “Scene-linked Symbology to Improve Situation Awareness,” AGARD Conference Proceedings, No. 555, Aerospace Medical Panel Conference on Situation Awareness, 16:1-16:11, 1995. [cited by applicant]
McLean, W., et al., “A Performance History of AN/PVS-5 and ANVIS Image Intensification Systems in U.S. Army Aviation (Reprint),” USAARL Report No. 98-28, U.S. Army Aeromedical Research Laboratory, Ft. Rucker, AL, May 19… [cited by applicant]
Melzer, J., et al., “An integrated approach to helmet display system design,” Optical and Helmet Systems Department, Kaiser Electronics, SPIE, vol. 778, Display System Optics, pp. 83-87, 1987. [cited by applicant]
Milgrani, P., et al., “Augmented Reality: A class of displays on the reality-virtuality continuum,” ATR Communication Systems Research Laboratories, SPIE, vol. 2351, Telemanipulator and Telepresence Technologies, 1994. [cited by applicant]
Moore, J., et al., “The Use of Simulation and Modeling for Acquisition, Requirements, and Training (Smart) in the Virtual Cockpit Optimization Program (VCOP),” The Interservice/Industry Training, Simulation and Educatio… [cited by applicant]
Nelson, S., et al., “Arthroscopic knee surgery using the advanced flat panel high-resolution color head-mounted display,” Proc. SPIE, vol. 3058, Head-Mounted Displays II, doi: 10.1117/12.276640, pp. 170-177, Jun. 18, 19… [cited by applicant]
Primeau, G., “Wide-field-of-view SVGA sequential color HMD for use in anthromorphic telepresence applications,” Proceedings of SPIE, vol. 4021, Helmet- and Head-Mounted Displays V., doi: 10.1117/12.389147, pp. 11-19, Ju… [cited by applicant]
Rash, C., “Shutting Out the Noise,” Flight Safety Foundation, Aviationsafetyworld, pp. 42-45, Nov. 2006. [cited by applicant]
Rolland, J., et al., “Head-Mounted Projective Displays for Creating Collaborative Environments,” Proceedings of SPIE, vol. 4711, pp. 395-399, 2002. [cited by applicant]
Simons, R., et al., “Visualization Solutions for AVCATT-A Reconfigurable Cockpits,” The Interservice/Industry Training, Simulation and Education Conference (I/ITSEC), Orlando, FL, 2002. [cited by applicant]
Sutherland, I., “The Ultimate Display,” Proceedings of the IFIP Congress 2, pp. 506-508, 1965. [cited by applicant]
White, J., “Knighthelm 24-hour HMD: from development to production,” Proceedings of SPIE, vol. 4361, Helmet- and Head-Mounted Displays VI, doi: 10.1117/12.437991, pp. 164-175, Aug. 22, 2001. [cited by applicant]
Kumar, et al., “Correlation Pattern Recognition”, published 2005, pp. 149-150. [cited by applicant]
Quantum3d, Inc., Daggers: Embedded Training for Dismounted Soldiers Science and Technology Objective (STO), <http://www.quantum3d.com/PDF/sstories/SStories_Daggers.pdf>, 2004. [cited by applicant]
Sensor Technology Systems, Inc., Model 2733 Low Profile/Night Vision Goggle: AN/PVS-21: Operational Summary, 2004. [cited by applicant]
National Defense Magazine, Can the Army Make Objective Force Warrior Work?, <http://www.nationaldefenesemagazine.org/articl.cfm?id=1173>, Aug. 2003. [cited by applicant]
Intersense, Inc., Intersense InertiaCube2, <http://www.isense.com/products/prec/ic2/inertiaCube2.pdf>, 2004. [cited by applicant]
Yeh, Michelle, et al., “Effects of Frame of Reference and Viewing Condition on Attentional Issues with Helmet Mounted Displays”, Technical Report, Jan. 1998, pp. 1-75. [cited by applicant]
Livingston, Mark A., et al., “Evaluating System Capabilities and User Performance in the Battlefield Augmented Reality System”, published in Proc. NIST/DARPA Workshop on Performance Metrics for Intelligent Systems, Gait… [cited by applicant]
“Competitive Analysis: Ground Guidance”, downloaded from <http://www.primoridal.com> on Dec. 11, 2006, 9 pages. [cited by applicant]
“Whitepaper: Ground Guidance”, downloaded from <http://www.primordial.com> on Dec. 11, 2006, 15 pages. [cited by applicant]
“Primordial Soldier: Vision System for Soldiers”, Product Sheet, downloaded from <http://www.primordial.com> on Dec. 11, 2006, 2 pages. [cited by applicant]
Primordial Soldier: Geographically-Enabled Augmented Reality System for Dismounted Soldiers (A05-119), Presentation, downloaded from <http://www.primordial.com> on Dec. 11, 2006, 35 pages. [cited by applicant]
“Primordial Solder User Manual”, downloaded from <http://www.primordial.com> on Dec. 11, 2006, 28 pages. [cited by applicant]
“Primordial Soldier, Vision system software for soldiers”, downloaded from <http://www.primordial.com> on Dec. 11, 2006, 6 pages. [cited by applicant]
“Competitive Analysis: Unit Detection, Differentiating friend from foe and assessing threats in a soldier's head-mounted display”, downloaded from <http://www.primordial.com> on Dec. 11, 2006, 8 pages. [cited by applicant]
“Whitepaper: Unit Detection, Differentiating friend from foe and assess threats in a soldier's head-mounted display”, downloaded from <http://www.primordial.com> on Dec. 11, 2006, 16 pages. [cited by applicant]
“Commander's Digital Assistance (CDA)”, General Dynamics C4, downloaded from <http://www.defense-update.com> on Dec. 11, 2006, 3 pages. [cited by applicant]
Web pages regarding AN/PVS-21, STS Sensor Technology Systems, downloaded from <http://www.sts-eo.com> on Jan. 11, 2007, 9 pages. [cited by applicant]
Marty Whitford, “Friend or Foe?, FBCB2 Enhances Battle Planning, Reduces ‘Friendly Fire’”, GPS World, Feb. 1, 2005, downloaded from <http://www.gpsworld.com/gpsworld> on Dec. 11, 2006, 10 pages. [cited by applicant]
InterSense InertiaCube3 and IC3 Processor, Intersense, downloaded from <http://www.intersense.com> prior to Feb. 28, 2007, 1 page. [cited by applicant]
Eric Foxlin, Chapter 7: Motion Tracking Requirements and Technologies, Handbook of Virtual Environment Technology, InterSense Inc., downloaded from <http://www.intersense.com> prior to Feb. 28, 2007, 54 pages. [cited by applicant]
Walrath, James D., “Information Technology for the Soldier: The Human Factor,” Army Research Laboratory (ARL-TR-3525), May 2005, 18 pages. [cited by applicant]
Defendant Motion to Dismiss in Court of Federal Claims case 1:17-cv-00825-EGB (filed Oct. 16, 2017). [cited by applicant]
Plaintiff Opposition to Motion to Dismiss in Court of Federal Claims case 1:17-cv-00825-EGB (filed Nov. 13, 2017). [cited by applicant]
Defendant Reply to Plaintiff Opposition to Motion to Dismiss in Court of Federal Claims case 1:17-cv-00825-EGB (filed Nov. 27, 2017). [cited by applicant]
Order Denying Motion to Dismiss in Court of Federal Claims case 1:17-cv-00825-EGB (entered Jan. 19, 2018). [cited by applicant]
Navy SBIR FY04.2 Proposal Submission, N04-155, Sensor for Simultaneous Movement and Directed Weapons Fire in Day/Low/No-light, on or before Apr. 2004. [cited by applicant]
Randello, J.S., et al., “The Integrated Sight: Future Improvement for Land Warroior,” Proceedings of SPIE 3394, Sensor Technology for Soldier Systems, doi: 10.1117/12.321043, (Event: Aerospace/Defense Sensing and Contro… [cited by applicant]
Palmer, B., “The Wired Warrior: The Army and Partner Raytheon Reinvent the Foot Soldier for the Digital Battlefield,” Fortune, vol. 138, Issue 12, Dec. 21, 1998. [cited by applicant]
“Raytheon to Produce a New Lightweight Thermal Weapon Sight for the U.S. Army,” Photonics Online, <https://www.photonocisonline.com/doc/raytheon-to-produce-a-new-lightweight-thermal-0001>, Mar. 4, 1999. [cited by applicant]
Pike, J. and Sherman R., “Land Warrior,” FAS Military Analysis Network, <https://fas.org/man/dod-101/sys/land/land-warror.htm>, Aug. 7, 1999. [cited by applicant]
Caldwell, J., “JCF-AWE to test digitizing light forces,” Army News Service, <https://fas.org/man/dod-101/sys/land/docs/man-la-land_warrior-000828.htm>, Aug. 28, 2000, 3 pages. [cited by applicant]
Strine, J., “Final JCF-AWE attack shows equipment works,” Army News Service, Ft. Polk, Louisiana, <https://fas.org/man/dod-101/sys/land/docs/man-la-land_warrior-000920.htm>, Sep. 20, 2000. [cited by applicant]
Graves, W., “Land Warrior' night live-fire sheds light on future,” Army News Service, Ft. Polk, Louisiana, <https://fas.org/man/dod-101/sys/land/docs/man-la-land_warrior-000918.htm>, Sep. 18, 2000. [cited by applicant]
Jontz, S., “Exercises will help determine whether ‘light’ is right for Army,” Washington Bureau, Stars and Strips, <https://fas.org/man/dod-101/sys/land/docs/man-la-land_warrior-000824.htm>, Aug. 24, 2000. [cited by applicant]
“Raytheon delivers radios for Land Warrior,” Military & Aerospace Electronics, McKenney, TX, <https://www.militaryaerospace.com/articles/2005/07/raytheon-delivers-radios-for-land-warrior.html>, Jul. 27, 2005. [cited by applicant]
Azuma, R., “A Survey of Augmented Reality,” Presence: Teleoperators and Virtual Environments, vol. 6, No. 4, pp. 355-385, Aug. 1997. [cited by applicant]
You, S., et al., Orientation Tracking for Outdoor Augmented Reality Registration, IEEE Computer Graphics and Applications, Virtual Reality, pp. 36-42, Nov./Dec. 1992. [cited by applicant]
Azuma, R., “Predictive Tracking for Augmented Reality,” Dissertation for degree of Doctor of Philosophy, Department of Computer Science, CB#3175, Sitterson Hall, UNC—Chapel Hill, Chapel Hill, NC 27599-3175, Feb. 1995. [cited by applicant]
Brown, Lisa, G., “A Survey of Image Registration Techniques,” ACM Computing Surveys (CSUR), vol. 24, No. 4, pp. 325-376, Dec. 1992. [cited by applicant]
You, S., et al., “Hybrid Inertial and Vision Tracking for Augmented Reality Registration,” IEEE Virtual Reality '99 Conference, pp. 260-267, Mar. 13-17, 1999. [cited by applicant]
Azuma, et al., “Improving Static and Dynamic Registration in an Optical See-through HMD,” Proceedings of SIGGRAPH '94, Computer Graphics, Annual Conference Series, pp. 197-204, Orlando, FL, Jul. 24-29, 1994. [cited by applicant]
Lobo, J., et al., “Vision and Inertial Sensor Cooperation Using Gravity as a Vertical Reference,” IEEE Transactions on Pattern Analysis and Machine Ingelligence, vol. 25, No. 12, Dec. 2003. [cited by applicant]
Zitova, B., et al., “Image Registration Methods: A Survey,” Image and Vision Computing, 21, 977-1000, Received Nov. 2001, Accepted Jun. 2003. [cited by applicant]
Steding, T., et al., “Optimum Filters for Image Registration,” IEEE Transactions on Aerospace and Electronic Systems, vol. AES-15, No. 6, Nov. 1979. [cited by applicant]
Bell, B.W., et al., “Error Analysis of Image Matching Using a Non-Planar Object Model,” Proceedings of SPIE 4741, Battelspace Digitization and Network-Centric Warfare II, vol. 4741, doi: 10.1117/12.478726, Aug. 2002. [cited by applicant]
Laliberté, F., et al., “Registration and Fusion of Retinal Images—An Evaluation Study,” IEEE Transactions on Medical Imaging, vol. 22, No. 5, May 2003. [cited by applicant]
Yocky, D., “Image Merging and Data Fusion by Means of the Discrete Two-Dimensional Wavelet Transform,” J. Opt. Soc. Am. A, vol. 12, No. 9, pp. 1834-1841, Sep. 1995. [cited by applicant]
Thurman, S., et al., “Image Registration for Fizeau Fourier Transform Imaging Spectroscopy,” The Institute of Optics, University of Rochester, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspect… [cited by applicant]
Núñez, J., et al., “Multiresolution-Based Image Fusion with Additive Wavelet Decomposition,” IEEE Transactions on Geoscience and Remote Sensing, vol. 37, No. 3, pp. 1204-1211, doi: 10.1109/36.763274, May 1999. [cited by applicant]
Kozaitis, S., “Image Preprocessing for Phase-Only Filtering,” Proceedings of SPIE, Optical Information Processing Systems and Architecture, vol. 1151, pp. 154-164, Aug. 1989. [cited by applicant]
Wickens, C., et al., “Conformal Symbology, Attention Shifts, and the Head-Up Display,” Proceedings of the Human Factors and Ergonomics Society 38th Annual Meeting, pp. 6-10, 1994. [cited by applicant]
Wood, R., “Holographic Head-Up Displays,” Electro-Optical Displays, in: Karim, M., (Ed.), New York: Marcel Dekker, pp. 337-415, 1992. [cited by applicant]
Yona, Z., et al., “Day/night ANVIS/HUD-24 (day HUD) flight test and pilot evaluations,” Proceedings of SPIE, vol. 5442, Helmet- and Head-Mounted Displays IX: Technologies and Applications, doi: 10.1117/12.543440, Sep. 8… [cited by applicant]
Belt, Ronald A.; Jim Kelley, Jim Kelley, Gary Knowles, Ronald J. Lewandowski, “Combat vehicle visualization system,” Proc. SPIE 4021, Helmet- and Head-Mounted Displays V, (Apr. 24, 2000), 28 pages. [cited by applicant]
Bigwood, C., Thermal Imager for dismounted infantry, /www.spiedigitallibrary.org/conference-proceedings-of-spie/5612/0000/Thermal-image-for-dismounted-infantry/10.1117/12.578489, (2004), 3 pages. [cited by applicant]
Centric, et al., Observations of Infantry Courses: Implications for Land Warrior (LW) Training, U.S. Army Research Institute for the Behavioral and Social Sciences, Jan. 2000, 104 pages. [cited by applicant]
Chapman, F.W. et al., “The Advent of Helmet-Mounted Devices in the Combat Aircraft Cockpit—An Operator Viewpoint.” Proceedings of SPIR, 1695, 26-37, (1992), 12 pages. [cited by applicant]
De Vos, G. et al., “Use of Holographic Optical Elements in HMDs.” Helmet Mounted Displays II, Proceedings of SPIE, 1290, 70-80, (1990), 12 pages. [cited by applicant]
Desert's Edge Research Laboratory, Final Report: Contract#DAAA21-93-M-1651 (Apr. 20, 1993), 54 pages. [cited by applicant]
Internet Archive version of Feb. 24, 2007, web page titled “FELIN (Fantassin à Équipements et Liaisons Intégrés)—Future Infantry Soldier System, France”. [cited by applicant]
Garamone, J., “Army Tests Land Warrior for 21st Century Soldiers,” DoD News, American Forces Press Service, http://archive.defense.gov/news/newsarticle.aspx?id=42267, (Sep. 11, 1998), 2 pages. [cited by applicant]
Geiselman, E.E., “Utility of Off-boresight Helmet-Mounted Symbology During a High Angle Airborne Target Acquisition Task.” Helmet- and Head-Mounted Displays and Symbology Design Requirements, Proceedings of SPIE, 2218, … [cited by applicant]
Girolamo, H.J., “Advanced Information Displays for the 21st Century Warrior.” Information Display, 13(3), 10-17, (1997), 8 pages. [cited by applicant]
Gizmag.com, “Trimersion HMD Takes First Person Shooter Games to a New Level of Reality,” http://www.gizmag.com/go/6410, (2007), 7 pages. [cited by applicant]
Hicks, J. et al., Eyekon: Distributed Augmented Reality for Soldier Teams, 21st Century Systems, Inc., Jun. 2003, 30 pages. [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 7,787,012, IPR2019-01311, Jul. 11, 2019, 75 pages. [cited by applicant]
Declaration of Dr. Matthew Turk PHD Regarding U.S. Pat. No. 8,817,103—IPR2019-01312, Jul. 11, 2019, 87 pages. [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 8,817,103, IPR2019-01312, Jul. 11, 2019, 81 pages. [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 9,229,230, IPR2019-01359, Jul. 22, 2019, 94 pages. [cited by applicant]
Declaration of Dr. Matthew Turk PHD, Regarding U.S. Pat. No. 9,229,230—IPR2019-01359,—01360, Jul. 19, 2019, 180 pages. [cited by applicant]
Declaration of Dr. Matthew Turk PHD Regarding U.S. Pat. No. 9,618,752, IPR2019-01361, Jul. 19, 2019, 129 pages. [cited by applicant]
Petition for Inter Partes Review of U.S. Pat. No. 9,618,752, IPR2019-01361, Jul. 23, 2019, 89 pages. [cited by applicant]
Land Warrior Review—1—Force XXI, In-Process Review Apr. 21-23, 1998, Motorola Space and Systems Technology Group, 126 pages. [cited by applicant]
Microsoft Press Computer Dictionary (3rd ed. 1997), 43 pages. [cited by applicant]
Naval SBIR-28, FY04.2 Proposal Submission, 41 pages. [cited by applicant]
New Oxford American Dictionary (2nd ed. 2005), 56 pages. [cited by applicant]
Rash, C.E. (Editor), “Helmet-Mounted Displays: Design Issues for the Rotary-Wing Environment.” Bellingham, WA: SPIE Press, (2000), 312 pages. [cited by applicant]
Reinhart, W., “Depth Cueing for Visual Search an Positioning.” Proceedings of SPIE, 1457, 221-232, (1992), 13 pages. [cited by applicant]
Roberts, “A Helmet Integration Case Study: Head Orientation Sensor Integration Into Land Warrior, The Design & Integration of Helmet Systems: Proc.,” Dec. 2-5, 1997, 18 pages. [cited by applicant]
U.S. Appl. No. 60/924,264, filed May 7, 2007, 268 pages. [cited by applicant]
Wahlde, R.V., Application of an Inertial Reticle System to an Objective Personal Weapon, Army Research Laboratory, Feb. 1996, 30 pages. [cited by applicant]
Weapon Systems 2002, United States Army (2002), 66 pages. [cited by applicant]
Wolff, “Sensor for Simultaneous Movement and Directed Weapons Fire in Day/Night Conditions,” May 2007, 268 pages. [cited by applicant]
Zintsmaster, L.R., “Wide-Eye Helmet Mounted Display System for Rotorcraft Applications.” IEEE Aerospace and Electronic Systems Magazine. 9(3), 6-11, (1994), 5 pages. [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]
Defendant's assertions from [cited by applicant]