IP Library Granted Patent US 11,112,859
Granted Patent B2
US 11,112,859 · App. 16/695,129 · Granted Sep 7, 2021

Electronic device displays an image of an obstructed target

Inventors: Philip Lyren (Bangkok, TH); Robert Lyren (Bangkok, TH)
G06F3/011H04W4/023
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,112,859
App. No.
16/695,129
Granted
Sep 7, 2021
Kind
B2
Abstract

An electronic device determines information about a target and provides the information to another electronic device that has an obstructed view of the target. The other electronic device displays an image of the target with an orientation and a location of the target.

Claims (45)

1. A method comprising:

capturing, with one or more electronics with a first user who wears a first head mounted display (HMD) on a head of the first user, information that includes a global positioning system (GPS) location of the first user and a direction that the first user is moving;

capturing, with one or more electronics with a second user who wears a second HMD on a head of the second user, information that includes a GPS location of the second user and a direction that the second user is moving; and

automatically displaying, with a display of the second HMD and in response to a direction of gaze of the second user being at a predetermined direction, an augmented reality (AR) image of a map that shows the first user, the second user, the direction that the first user is moving, and the direction that the second user is moving.

2. The method of claim 1 further comprising:

automatically removing, from the display of the second HMD, the AR image of the map in response to detecting the direction of gaze of the second user is no longer at the predetermined direction.

3. The method of claim 1 further comprising:

moving, on the AR image of the map displayed with the second HMD, the first user in real-time with movements of the first user.

4. The method of claim 1 further comprising:

tracking, with the one or more electronics with the first user, different orientations of a rifle of the first user as the first user moves the rifle; and

storing, in memory, the different orientations of the rifle.

5. The method of claim 1 further comprising:

displaying, with the display the second HMD, a target that is obstructed by a physical object and not visible with a naked eye of the second user; and

moving, on the display of the second HMD, the target to coincide with real-time movements of the target.

6. The method of claim 1 further comprising:

automatically displaying, with the display of the second HMD and in response the direction of gaze of the second user being at a second predetermined direction, an AR compass that shows the direction in which the second user is moving.

7. The method of claim 1 further comprising:

displaying, with the display of the second HMD, real-time video of infrared (IR) images of a target captured with a camera mounted to a rifle of the first user.

8. The method of claim 1 , wherein the AR image of the map automatically displays when the direction of gaze of the second user is to ground.

9. A method comprising:

sharing, to a map and from one or more electronic devices with a first user who wears a first head mounted display (HMD), information that includes a location of the first user and a direction that the first user is facing; and

automatically displaying, with a display of a second HMD worn on a head of a second user and in response to detecting a direction of gaze of the second user being at a first predetermined direction, a virtual image of the map that simultaneously shows a target, the first user, the second user, the direction that the first user is facing, and a direction that the second user is facing.

10. The method of claim 9 further comprising:

automatically displaying, with the display of the second HMD worn on the head of the second user and in response to detecting the direction of gaze of the second user being at a second predetermined direction, a virtual image of a compass that shows the direction that the second user is facing.

11. The method of claim 9 further comprising:

tracking, with the one or more electronics with the first user, an orientation of a head of the first user and an orientation of a rifle held by the first user.

12. The method of claim 9 further comprising:

capturing, with an infrared (IR) camera mounted to a rifle held by the first user, an IR image of the target; and

displaying, with a display of the first HMD, a virtual image over the IR image of the target to supplement the IR image of the target.

13. The method of claim 9 further comprising:

detecting, with the second HMD, when the second user is looking in a direction of the target; and

highlighting, with the display of the second HMD and in response to the detecting that the second user is looking in the direction of the target, the target with a virtual image over the target.

14. The method of claim 9 further comprising:

transmitting, from the first HMD worn on a head of the first user and to the second HMD worn on the head of the second user, infrared (IR) video of the target captured with a camera mounted to a rifle of the first user; and

displaying, with the display of the second HMD, the IR video captured with the camera mounted to the rifle of the first user.

15. The method of claim 9 further comprising:

transmitting, from the first HMD worn on a head of the first user and to the second HMD worn on the head of the second user, video of the target that includes an area around the target and crosshairs where a rifle of the first user is aimed; and

displaying, with the display of the second HMD, the video of the target that includes the area around the target and the crosshairs where the rifle is aimed.

16. An electronic device system, comprising:

a first head mounted display (HMD) worn on a head of a first user and including a first camera that tracks a gaze of the first user and a first display that displays a virtual compass that shows a compass direction of the first user in response to the first camera detecting the gaze of the first user being in a predetermined direction; and

a second HMD worn on a head of a second user and including a second camera that tracks a gaze of the second user and a second display that displays a virtual compass that shows a compass direction of the second user in response to the second camera detecting the gaze of the second user being in a predetermined direction,

wherein first HMD automatically displays a virtual map in response to the first camera detecting the gaze of the first user being in another predetermined direction, wherein the virtual map simultaneously shows the first user, the second user, the direction of the first user, and the direction of the second user.

17. The electronic device system of claim 16 , wherein the first display of the first HMD displays an infrared (IR) image of a target captured with electronics mounted to a rifle of the first user, and the first display of the first HMD highlights the IR image with a virtual image placed over the IR image.

18. The electronic device system of claim 16 , wherein the first display of the first HMD displays a virtual image of a target that is obstructed from view of a naked eye of the first user, and the virtual image of the target being displayed with the first display moves in real-time with movements of the target.

19. The electronic device system of claim 16 , wherein electronics with the first user transmit, to electronics with the second user, video of a target and crosshairs that show a point of aim of a rifle with the first user, and wherein the second display of the second HMD displays the video of the target and the crosshairs.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2022
From: LYREN, PHILIP SCOTT; LYREN, ROBERT LOUIS
To: ADVANCED AR SYSTEMS, LLC
Reel/Frame 061589/0027 →
Continuity (5)
Continuation 16252729 · Jan 21, 2019
Continuation 15784230 · Oct 16, 2017
Continuation 14823542 · Aug 11, 2015
Provisional Application 62065672 · Oct 19, 2014
Related Publication 20200097073A1 · Mar 26, 2020
Cited By (1)
US 12,288,005