IP Library Granted Patent US 11,410,419
Granted Patent B2
US 11,410,419 · App. 16/319,446 · Granted Aug 9, 2022

Enhanced vision systems and methods

Inventors: Jon Burnsed (Tempe, AZ); Stephen Styonavich (Tempe, AZ); Michael Iosue (Tempe, AZ)
Assignee: L3 TECHNOLOGIES, INC.
G06V20/20G02B23/12G02B25/001G02B27/0101H04N5/2257H04N5/2258H04N5/232939H04N5/332F41G1/38F41G3/145G02B2027/013G02B2027/014G02B2027/0138G02B2027/0141G02B2027/0147
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,410,419
App. No.
16/319,446
Granted
Aug 9, 2022
Kind
B2
Abstract

An enhanced vision system includes a first optic subsystem and a transparent photodetector subsystem disposed within a common housing. The first optic subsystem may include passive devices such as simple or compound lenses, active devices such as low-light enhancing image intensifiers, or a combination of passive and active devices. The transparent photodetector subsystem receives the visible image exiting the first optic subsystem and converts a portion of the electromagnetic energy in the visible image to a signal communicated to image analysis circuitry. On a real-time or near real-time basis, the image analysis circuitry detects and identifies structures, objects, and/or individuals in the visible image. The image analysis circuitry provides an output that includes information regarding the structure, objects, and individuals to the system user contemporaneous with the system user viewing the visible image.

Claims (97)

1. An enhanced vision system comprising:

a first optic subsystem configured to transmit a first scene within a field-of-view in at least a visible portion of the electromagnetic spectrum; and

a transparent photodetector subsystem configured to transmit the first scene within the field-of-view from the first optic subsystem, the transparent photodetector subsystem comprising

a transparent substrate, and

a first photosensitive element array on at least a portion of a first surface of the transparent substrate and configured to receive a first portion of the first scene.

2. The enhanced vision system of claim 1 further comprising:

a configurable circuit coupled to the transparent photodetector subsystem; and

a storage device configured to cooperate with the configurable circuit to

receive a first signal representative of the first portion of the first scene from the first photosensitive element array,

determine at least one parameter associated with at least one object appearing within the first scene, and

generate one or more output signals representative of the at least one parameter associated with the at least one object.

3. The enhanced vision system of claim 2 wherein the first optic subsystem is aligned along a first optical axis; wherein the transparent photodetector subsystem is aligned along a second optical axis; and further comprising at least one spectral redirector configured to transition at least a portion of electromagnetic energy emitted by the first optic subsystem in a first path parallel to the first optical axis to a second path parallel to the second optical axis.

4. The enhanced vision system of claim 3 further comprising eyepiece optics aligned along the second optical axis to output a reduced size image of the first scene along the second optical axis.

5. The enhanced vision system of claim 3 wherein the at least one spectral redirector comprises at least one of: a plurality of mirrored surfaces and at least one prismatic member.

6. The enhanced vision system of claim 3 wherein the first optical axis and the second optical axis are collinear.

7. The enhanced vision system of claim 3 further comprising:

a transparent display subsystem coupled to the configurable circuit and configured to:

receive the one or more output signals;

and

contemporaneously display at least a portion of the one or more output signals and the first portion of the first scene aligned with each other.

8. The enhanced vision system of claim 7 further comprising:

line-of-sight circuitry coupled to the configurable circuit; and

an external device coupled to the line-of-sight circuitry and configured to provide an output signal that includes at least a portion of a field-of-view of the external device.

9. The enhanced vision system of claim 7 further comprising a wireless network interface configured to receive data from one or more remote resources; wherein the received data includes data associated with the at least one object that appears in the first scene within the field-of-view of the first optic subsystem; and wherein the configurable circuit is configured to generate a display output that includes at least a portion of the received data.

10. The enhanced vision system of claim 2 wherein the transparent photodetector subsystem further comprises a second transparent substrate, and a second photosensitive element array on the second transparent substrate, the second photosensitive element array positioned to capture a second scene entering the transparent photodetector subsystem from a direction opposite the first scene.

11. The enhanced vision system of claim 10 wherein the second photosensitive element array is adjacent at least a portion of a second surface transversely opposed to the first surface of the transparent substrate; and

wherein the configurable circuit is configured to:

receive a second signal from the second photosensitive element array and indicative of a user eye parameter; and

select at least one command for execution based at least in part on the received second signal.

12. The enhanced vision system of claim 10 wherein the second photosensitive element array is adjacent at least a portion of a first surface of the second transparent substrate; and wherein the configurable circuit is configured to:

receive a second signal from the second photosensitive element array and indicative of a user eye parameter; and

select at least one command for execution based at least in part on the received second signal.

13. The enhanced vision system of claim 2 wherein the transparent display subsystem comprises

a transparent prismatic member configured to transit therethrough an image of the first scene visible along the second optical axis, and

internally reflect an emitted display output from a surface of the transparent prismatic member and exiting the prismatic member along the second optical axis.

14. The enhanced vision system of claim 13 wherein the transparent display subsystem comprises an emissive transparent display device coupled to the configurable circuit and configured to emit a display output so that the image of the first scene visible along the second optical axis is transmitted through at least a portion of the emissive transparent display device.

15. The enhanced vision system of claim 1 wherein the first optic subsystem is configured to transform a spectral distribution of the first scene from a first spectral distribution incident upon the first optic subsystem to a second spectral distribution exiting the first optic subsystem, the second spectral distribution being in at least the visible portion of the electromagnetic spectrum.

16. The enhanced vision system of claim 15 wherein the first optic subsystem comprises an image intensifier.

17. The enhanced vision system of claim 16 wherein the transparent photodetector subsystem is on at least a portion of an exterior surface of the image intensifier.

18. An enhanced vision method comprising:

receiving, by a first optic subsystem, incident electromagnetic energy that includes a first scene in a field-of-view of the first optic subsystem;

outputting, by the first optic subsystem, visible electromagnetic energy including at least a portion of the first scene;

receiving, by a first photosensitive element array on a transparent substrate in a transparent photodetector subsystem, at least the visible electromagnetic energy from the first optic subsystem;

generating, by the first photosensitive element array, a first signal indicative of at least a portion of the first scene; and

transmitting, by the transparent photodetector subsystem, at least the visible electromagnetic energy from the first optic subsystem that includes at least a portion of the first scene.

19. The enhanced vision method of claim 18 further comprising:

receiving, at a configurable circuit, the first signal generated by the first photosensitive element array;

determining, by the configurable circuit, at least one parameter associated with at least one object appearing in the first scene; and

generating, by the configurable circuit, a first output signal representative of the at least one parameter associated with the object appearing in the first scene.

20. The enhanced vision method of claim 19 further comprising aligning the first optic subsystem with a first optical axis; wherein the outputting of the visible electromagnetic energy includes:

outputting, by the first optic subsystem, the visible electromagnetic energy along a path parallel to the first optical axis;

redirecting, via a spectral redirector, the visible electromagnetic energy from the path parallel to the first optical axis to a path parallel to a second optical axis; and

aligning a center of the transparent photodetector subsystem with the second optical axis,

wherein the transmitting of the visible electromagnetic output from the first optic subsystem includes transmitting at least the visible electromagnetic output from the first optic subsystem along the path parallel to the second optical axis.

21. The enhanced vision method of claim 20 wherein the redirecting of the visible electromagnetic energy output comprises at least one of: redirecting, via a spectral redirector that includes a plurality of mirrored surfaces; and redirecting, via the spectral redirector that includes at least one prismatic member.

22. The enhanced vision method of claim 20 further comprising aligning the first optic subsystem with a first optical axis; wherein the outputting of the visible electromagnetic energy includes:

outputting, by the first optic subsystem, the visible electromagnetic energy output along a path parallel to the first optical axis; and

aligning a center of the transparent photodetector subsystem with the second optical axis;

wherein transmitting at least the visible electromagnetic output from the first optic subsystem includes transmitting at least the visible electromagnetic energy from the first optic subsystem along the path parallel to the first optical axis.

23. The enhanced vision method of claim 20 further comprising:

receiving, by a transparent display subsystem coupled to the configurable circuit, the first output signal generated by the configurable circuit;

generating, via the transparent display subsystem, a display output that includes at least a portion of the first output signal; and

displaying at least a portion of the at least one parameter associated with the at least one object such that the at least the portion of the at least one parameter is aligned and contemporaneously viewable by a system user with the visible electromagnetic energy.

24. The enhanced vision method of claim 23 wherein receiving, by the transparent display subsystem coupled to the configurable circuit, the first output signal generated by the configurable circuit further comprises:

receiving, by an image projector coupled to the configurable circuit, the first output signal generated by the configurable circuit; projecting, by the image projector, the display output through at least one transparent prismatic member such that:

the first scene visible along the second optical axis is transmitted through the transparent prismatic member; and

the display output internally reflects from a surface of the prismatic member and exits the prismatic member along the second optical axis.

25. The enhanced vision method of claim 23 wherein receiving, by the transparent display subsystem coupled to the configurable circuit, the first output signal generated by the configurable circuit further comprises:

an image projector coupled to the configurable circuit, the image projector to generate the display output; and

a plurality of reflective members such that the display output reflects from at least some of the plurality of reflective members and is emitted along the second optical axis.

26. The enhanced vision method of claim 23 wherein receiving, by the transparent display subsystem coupled to the configurable circuit, the first output signal generated by the configurable circuit comprises:

receiving, by an emissive transparent display device coupled to the configurable circuit and disposed along the second optical axis, the first output signal generated by the configurable circuit; and

displaying the display output contemporaneous with the visible electromagnetic energy that includes at least a portion of the first scene transmitted by the transparent photodetector subsystem.

27. The enhanced vision method of claim 23 further comprising:

receiving, at the configurable circuit, an output signal associated with a second scene from line-of-sight imaging circuitry coupled to the configurable circuit and operably coupled to at least one external device;

combining, by the configurable circuit, at least some of the first scene included in the first signal with at least some of the second scene included in the output signal from the line-of-sight imaging circuitry; and

causing a display on the transparent display subsystem that includes the first scene combined with the second scene contemporaneously with the first scene transmitted through the transparent display subsystem.

28. The enhanced vision method of claim 19 further comprising:

receiving, via a second photosensitive element array on a second surface of a transparent substrate transversely opposed to a first surface of the transparent substrate, at least a first portion of an electromagnetic spectrum that includes at least a portion of a second scene incident upon the second photosensitive element array from a second direction that is opposite the first scene;

generating, by the second photosensitive element array, a second output signal representative of the second scene that includes at least a portion of a system user;

receiving, by the configurable circuit, the second output signal;

determining, by the configurable circuit, at least one biometric parameter associated with the system user and included in the second output signal generated by the second photosensitive element array; and

selecting, by the configurable circuit, at least one command for execution based at least in part on the determined at least one biometric parameter.

29. The enhanced vision method of claim 18 wherein the outputting of the visible electromagnetic energy comprises outputting, by an image intensifier, electromagnetic energy in a visible second electromagnetic spectrum that includes at least the portion of the first scene.

30. The enhanced vision method of claim 29 wherein receiving, by the first photosensitive element array, at least the visible electromagnetic energy from the first optic subsystem comprises receiving, by the first photosensitive element array, at least a portion of the visible second electromagnetic output that includes at least the portion of the first scene from the image intensifier.

31. A vision system comprising:

a first optical device configured to transmit a first scene within a field-of-view in at least a visible portion of the electromagnetic spectrum;

a transparent photodetector device configured to transmit the first scene within the field-of-view from the first optical device, the transparent photodetector device comprising

a transparent substrate, and

a first photosensitive element array on at least a portion of a first surface of the transparent substrate and configured to receive a first portion of the first scene;

a processor coupled to the transparent photodetector device and configured to

receive a first signal of the first portion of the first scene from the first photosensitive element array,

determine at least one parameter associated with an object in the first scene, and

generate at least one output signal of the at least one parameter associated with the object; and

a transparent display device coupled to the processor and configured to

receive the at least one output signal, and

contemporaneously display at least a portion of the at least one output signal and the first portion of the first scene aligned with each other.

Assignments (12)
SECURITY INTEREST Recorded Aug 11, 2023
From: EOTECH, LLC
To: KEYBANK NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 064571/0724 →
NOTICE OF RELEASE OF SECURITY INTEREST IN PATENT COLLATERAL Recorded Jul 21, 2023
From: BLUE TORCH FINANCE LLC, AS COLLATERAL AGENT
To: EOTECH, LLC; HEL TECHNOLOGIES, LLC
Reel/Frame 064356/0155 →
DECLARATION UNDER 323.01(C) TO CORRECT AN ERROR IN A PREVIOUSLY RECORDED DOCUMENT THAT ERRONEOUSLY AFFECTS THE IDENTIFIED APPLICATION Recorded Apr 25, 2022
From: EOTECH, LLC
To: EOTECH, LLC
Reel/Frame 059790/0991 →
PATENT SECURITY AGREEMENT Recorded Apr 19, 2022
From: EOTECH, LLC
To: BLUE TORCH FINANCE LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 059725/0564 →
RELEASE OF SECURITY INTEREST Recorded Apr 12, 2022
From: PNC BANK, NATIONAL ASSOCIATION
To: EOTECH, LLC
Reel/Frame 059569/0380 →
PATENT SECURITY AGREEMENT Recorded Dec 30, 2021
From: EOTECH, LLC; HEL TECHNOLOGIES, LLC
To: BLUE TORCH FINANCE LLC
Reel/Frame 058600/0351 →
RELEASE OF SECURITY INTEREST Recorded Dec 23, 2021
From: MERION INVESTMENT PARTNERS III, L.P
To: EOTECH, LLC
Reel/Frame 058474/0744 →
DECLARATION OF PATENT APPLICATION OWNER UNDER MPEP §323.01(C) REGARDING ASSIGNMENT(S) AND SECURITY INTEREST(S) IMPROPERLY RECORDED BY ANOTHER PERSON AGAINST OWNER'S PATENT APPLICATION Recorded Jul 22, 2021
From: L3 TECHNOLOGIES, INC.
To: L3 TECHNOLOGIES, INC.
Reel/Frame 057246/0748 →
SECURITY INTEREST Recorded Aug 26, 2020
From: EOTECH, LLC
To: MERION INVESTMENT PARTNERS III, L.P.
Reel/Frame 053605/0138 →
SECURITY INTEREST Recorded Aug 19, 2020
From: EOTECH, LLC
To: PNC BANK, NATIONAL ASSOCIATION
Reel/Frame 053543/0563 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2020
From: L3 TECHNOLOGIES, INC.
To: EOTECH, LLC
Reel/Frame 053417/0817 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2019
From: BURNSED, JON; STYONAVICH, STEPHEN; IOSUE, MICHAEL
To: L-3 COMMUNICATIONS CORPORATION-INSIGHT TECHNOLOGY DIVISION
Reel/Frame 050039/0231 →