IP Library Granted Patent US 11,341,731
Granted Patent B1
US 11,341,731 · App. 17/334,867 · Granted May 24, 2022

Enhanced 3D training environment

Inventor: Robert Edwin Douglas (Winter Park, FL)
Assignee: TIPPING POINT MEDICAL IMAGES, LLC
G06T19/006A61B6/025A61B6/502A61B6/5211A61B90/39G02B27/017G06T7/0014G06T15/08A61B2090/3904G06T2207/10112G06T2207/10124G06T2207/20036G06T2207/30068
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,341,731
App. No.
17/334,867
Granted
May 24, 2022
Kind
B1
Abstract

A method for immersively displaying a scanned environment of a region to a set of users in a training environment wearing augmented reality head display units. The training environment includes a pseudo-GPS system, which allows position tracking over time. This enables rehearsing military operations before they occur.

Claims (93)

1. A method comprising:

selecting a dataset of a region wherein said dataset comprises a LIDAR scan of a region;

registering said dataset of said region to an area wherein said area contains barriers, wherein said barriers do not block intervisibility amidst members of a single group, and wherein said barriers block intervisibility amidst members of different groups;

implementing a transceiver system in said area;

receiving at a first time point, by an augmented reality head display unit (HDU) a first signal from said transceiver system wherein said HDU is located in said area,

processing said first signal, by a processor in communication with said HDU, to compute a first location of said HDU; and

generating a first image set of said region wherein said first image set comprises a first left eye image and a first right eye image

wherein said first left eye image is generated based on at least a first left eye viewpoint, a first left eye viewing angle and said dataset of said region,

wherein said first right eye image is generated based on at least a first right eye viewpoint, a first right eye viewing angle and said dataset of said region,

displaying said first image set on said HDU wherein said first left eye image is aligned with a left eye of a user and said first right eye image is aligned with a right eye of said user;

receiving, at a subsequent time point, by said HDU a subsequent signal from said transceiver system wherein said HDU is located in said area,

processing said subsequent signal, by said processor in communication with said HDU, to compute a subsequent location of said HDU wherein said subsequent location is different from said first location; and

generating a subsequent image set of said region wherein said subsequent image set comprises a subsequent left eye image and a subsequent right eye image

wherein said subsequent left eye image is generated based on at least a subsequent left eye viewpoint, a subsequent left eye viewing angle and said dataset of said region,

wherein said subsequent left eye viewpoint is different from said first left eye viewpoint,

wherein said subsequent left eye viewing angle is different from said first left eye viewing angle,

wherein said subsequent right eye image is generated based on at least a subsequent right eye viewpoint, a subsequent right eye viewing angle and said dataset of said region,

wherein said subsequent right eye viewpoint is different from said first right eye viewpoint,

wherein said subsequent right eye viewing angle is different from said first right eye viewing angle,

displaying said subsequent image set on said HDU wherein said subsequent left eye image is aligned with said left eye of said user and said subsequent right eye image is aligned with said right eye of said user.

2. The method of claim 1 further comprising wherein said region is different from said area.

3. The method of claim 2 further comprising wherein said HDU displays a location derived from a positioning system of said region.

4. The method of claim 3 further comprising wherein said positioning system comprises at least one of the group consisting of:

a global positioning system (GPS);

a nominal positioning system (NPS); and

a map and compass.

5. The method of claim 1 further comprising wherein an element of said HDU comprises an inertial measurement unit (IMU) wherein head tracking capabilities are enabled.

6. The method of claim 1 further comprising wherein said region comprises one of the group consisting of:

a battlefield;

a forest fire; and

a hurricane damaged region.

7. The method of claim 1 further comprising wherein said area comprises one of the group of:

a warehouse;

a room; and

a field.

8. The method of claim 7 further comprising wherein said warehouse area contains a transportation system in communication with a positioning system of said region.

9. The method of claim 1 further comprising wherein multiple additional users in said area wear HDUs and view 3D imagery of said region.

10. The method of claim 9 further comprising wherein said area can contains at least two of the group consisting of:

a friendly forces group;

a neutral forces group; and

an adversarial forces group.

11. The method of claim 10 further comprising wherein said friendly forces group and said adversarial forces group interact with one another such that virtual damage could be inflicted by the friendly forces group on the adversarial forces group and by the adversarial forces group on the friendly forces group.

12. The method of claim 11 further comprising wherein data from an interaction of said friendly forces group and said adversarial forces group is recorded.

13. The method of claim 12 further comprising wherein said recorded data can be summarized for subsequent analysis or education purposes.

14. The method of claim 10 further comprising:

wherein a virtual adversarial group is presented on HDU's of said friendly forces group; and

wherein a virtual friendly forces group is presented on HDU's of said adversarial forces group.

15. The method of claim 9 further comprising wherein said user and said multiple additional users carry equipment that can also be located via the transceiver system.

16. The method of claim 1 further comprising wherein said LIDAR is at least one of the group consisting of:

aircraft-based LIDAR;

space-based LIDAR;

water-based LIDAR; and

ground-based LIDAR.

17. The method of claim 1 further comprising wherein at least one additional user wearing HDU(s) is located in at least one additional area and views 3D imagery of said region wherein said at least one additional area is different from said area.

18. An augmented reality head display unit configured to:

receive at a first time point a first signal from a transceiver system located in an area wherein said HDU is located in said area, wherein said area contains barriers, wherein said barriers do not block intervisibility amidst members of a single group, and wherein said barriers block intervisibility amidst members of different groups,

process said first signal, by a processor in communication with said HDU, to compute a first location of said HDU; and

generate a first image set of said region wherein said first image set comprises a first left eye image and a first right eye image

wherein said first left eye image is generated based on at least a first left eye viewpoint, a first left eye viewing angle and a dataset of a region,

wherein said dataset of said region is registered to said area,

wherein said dataset of said region comprises a LIDAR scan of said region

wherein said first right eye image is generated based on at least a first right eye viewpoint, a first right eye viewing angle and said dataset of said region,

display said first image set on said HDU wherein said first left eye image is aligned with a left eye of a user and said first right eye image is aligned with a right eye of said user;

receive at a subsequent time point, by said HDU a subsequent signal from said transceiver system wherein said HDU is located in said area,

process said subsequent signal, by said processor in communication with said HDU, to compute a subsequent location of said HDU wherein said subsequent location is different from said first location; and

generate a subsequent image set of said region wherein said subsequent image set comprises a subsequent left eye image and a subsequent right eye image

wherein said subsequent left eye image is generated based on at least a subsequent left eye viewpoint, a subsequent left eye viewing angle and said dataset of said region,

wherein said subsequent left eye viewpoint is different from said first left eye viewpoint,

wherein said subsequent left eye viewing angle is different from said first left eye viewing angle,

wherein said subsequent right eye image is generated based on at least a subsequent right eye viewpoint, a subsequent right eye viewing angle and said dataset of said region,

wherein said subsequent right eye viewpoint is different from said first right eye viewpoint,

wherein said subsequent right eye viewing angle is different from said first right eye viewing angle; and

display said subsequent image set on said HDU wherein said subsequent left eye image is aligned with said left eye of said user and said subsequent right eye image is aligned with said right eye of said user.

19. A non-transitory computer readable medium having computer readable code thereon for three-dimensional viewing of images by a user, the medium comprising:

instructions for selecting a dataset of a region wherein said dataset comprises a LIDAR scan of said region;

instructions for registering said dataset of said region to an area, wherein said area contains barriers, wherein said barriers do not block intervisibility amidst members of a single group, and wherein said barriers block intervisibility amidst members of different groups;

instructions for implementing a transceiver system in said area;

instructions for receiving at a first time point, by an augmented reality head display unit (HDU) a first signal from said transceiver system wherein said HDU is located in said area,

instructions for processing said first signal, by a processor in communication with said HDU, to compute a first location of said HDU; and

instructions for generating a first image set of said region wherein said first image set comprises a first left eye image and a first right eye image

wherein said first left eye image is generated based on at least a first left eye viewpoint, a first left eye viewing angle and said dataset of said region,

wherein said first right eye image is generated based on at least a first right eye viewpoint, a first right eye viewing angle and said dataset of said region,

instructions for displaying said first image set on said HDU wherein said first left eye image is aligned with a left eye of a user and said first right eye image is aligned with a right eye of said user;

instructions for receiving at a subsequent time point, by said HDU a subsequent signal from said transceiver system wherein said HDU is located in said area,

instructions for processing said subsequent signal, by said processor in communication with said HDU, to compute a subsequent location of said HDU wherein said subsequent location is different from said first location; and

instructions for generating a subsequent image set of said region wherein said subsequent image set comprises a subsequent left eye image and a subsequent right eye image

wherein said subsequent left eye image is generated based on at least a subsequent left eye viewpoint, a subsequent left eye viewing angle and said dataset of said region,

wherein said subsequent left eye viewpoint is different from said first left eye viewpoint,

wherein said subsequent left eye viewing angle is different from said first left eye viewing angle,

wherein said subsequent right eye image is generated based on at least a subsequent right eye viewpoint, a subsequent right eye viewing angle and said dataset of said region,

wherein said subsequent right eye viewpoint is different from said first right eye viewpoint,

wherein said subsequent right eye viewing angle is different from said first right eye viewing angle,

instructions for displaying said subsequent image set on said HDU wherein said subsequent left eye image is aligned with said left eye of said user and said subsequent right eye image is aligned with said right eye of said user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2022
From: DOUGLAS, ROBERT EDWIN
To: TIPPING POINT MEDICAL IMAGES, LLC
Reel/Frame 058649/0976 →
Continuity (6)
Continuation In Part 17187828 · Feb 28, 2021
Continuation 17120109 · Dec 12, 2020
Continuation 16594139 · Oct 7, 2019
Continuation 17334867
Continuation In Part 15949202 · Apr 10, 2018
Provisional Application 62743837 · Oct 10, 2018