IP Library Granted Patent US 11,862,042
Granted Patent B2
US 11,862,042 · App. 17/466,009 · Granted Jan 2, 2024

Augmented reality for vehicle operations

Inventors: Daniel Augustine Robinson (Marina Del Rey, CA); Nikola Vladimir Bicanic (Venice, CA); Glenn Thomas Snyder (Venice, CA)
Assignee: RED SIX AEROSPACE INC.
G09B9/44G02B27/0172G06T19/006G09B9/206G09B9/302G09B9/307G09G5/10G09G5/37G02B2027/014G09G2354/00G09G2380/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,862,042
App. No.
17/466,009
Granted
Jan 2, 2024
Kind
B2
Abstract

An augmented reality system includes a geospatial location system adapted to identify a current location of a vehicle, a plurality of vehicle condition sensors adapted to identify the vehicle's positional attitude, direction of motion, and speed within an environment at the current location, a helmet position sensor system adapted to determine a location of a helmet within the vehicle and a viewing direction of a pilot wearing the helmet the helmet comprising a see-through computer display through which the pilot is enabled to see an environment outside of the vehicle with computer content overlaying the environment to create an augmented reality view of the environment for the pilot, a data storage module adapted to store the data from the geospatial location system, plurality of vehicle condition sensors and the helmet position sensor with a time of acquisition of each respective type of data and a processor adapted to present geospatially located augmented reality content to the helmet based, at least in part, on vehicle's current location and positional attitude.

Claims (26)

1. An augmented reality system, comprising:

a geospatial location system adapted to identify a current location of a vehicle;

a plurality of vehicle condition sensors adapted to identify the vehicle's positional attitude, direction of motion, and speed within an environment at the current location;

a helmet position sensor system adapted to determine a location of a helmet within the vehicle and a viewing direction of a pilot wearing the helmet the helmet comprising a see-through computer display through which the pilot is enabled to see an environment outside of the vehicle with computer content overlaying the environment to create an augmented reality view of the environment for the pilot;

a data storage module adapted to store the data from the geospatial location system, plurality of vehicle condition sensors and the helmet position sensor with a time of acquisition of each respective type of data; and

a processor adapted to present geospatially located augmented reality content to the helmet based, at least in part, on vehicle's current location and positional attitude.

2. The augmented reality system of claim 1 , wherein the processor is further adapted to analyze the stored data and generate a trend of the vehicle's locations, speed and conditions over a period of time, the processor further adapted to extrapolate the trend into a future period of time to produce a future predicted vehicle location and future positional attitude.

3. The augmented reality system of claim 2 , wherein a geospatial location and a perspective of the content is generated based, at least in part, on the future predicted vehicle location and future positional attitude and presented at a time approximating the future time used to generate the content.

4. A method comprising:

identifying a current location of a vehicle;

identifying the vehicle's positional attitude, direction of motion, and speed within an environment at the current location;

determining a location of a helmet within the vehicle and a viewing direction of a pilot wearing the helmet the helmet comprising a see-through computer display through which the pilot is enabled to see an environment outside of the vehicle with computer content overlaying the environment to create an augmented reality view of the environment for the pilot;

storing the data from the geospatial location system, plurality of vehicle condition sensors and the helmet position sensor with a time of acquisition of each respective type of data; and

presenting geospatially located augmented reality content to the helmet based, at least in part, on vehicle's current location and positional attitude.

5. The method of claim 4 , further comprising analyzing the stored data and generating a trend of the vehicle's locations, speed and conditions over a period of time, and extrapolating the trend into a future period of time to produce a future predicted vehicle location and future positional attitude.

6. The method of claim 5 , further comprising generating a geospatial location and a perspective of the content is generated based, at least in part, on the future predicted vehicle location and future positional attitude and presenting the content at a time approximating the future time used to generate the content.

7. A method of positioning augmented reality content, comprising:

receiving a series of progressively changing content geospatial locations representing future movement of a virtual asset within a virtual environment;

receiving a series of progressively changing vehicle geospatial locations, each associated with a then current acquisition time, representing movement of a real vehicle in a real environment, wherein the virtual environment geospatially represents the real environment;

predicting, based on the series of vehicle locations and related acquisition times, a future geospatial location of the vehicle; and

presenting the augmented reality content, representing the virtual asset, to an operator of the vehicle at a position within a field-of-view of a see-through computer display based on the future geospatial location of the vehicle and a geospatial location, from the series of progressively changing content geospatial locations, representative of a time substantially the same as a time represented by the future geospatial location.

8. The method of claim 7 , wherein the virtual environment is a training environment for the operator of the vehicle and the virtual asset represents at least one of a friendly asset, enemy asset, airplane, missile, ground asset and space asset.

9. The method of claim 7 , wherein the future movement of the virtual asset is at least partially based on the series of progressively changing vehicle geospatial locations.

10. The method of claim 7 , wherein the prediction of the future geospatial location of the vehicle is based at least in part on past geospatial vehicle locations identified by a sensor system affixed to the vehicle that periodically communicates a then current geospatial location; wherein the past geospatial vehicle locations are interpolated to form a past vehicle location trend.

11. The method of claim 10 , wherein the prediction of the future geospatial location of the vehicle is further based on an extrapolation based at least in part on the past vehicle trend.

12. The method of claim 7 , wherein the vehicle is further represented by an attitude within the real environment and the virtual asset is represented by an attitude within the virtual environment and the presentation of the augmented reality content is further based on the attitude of the vehicle and the attitude of the virtual asset.

Assignments (2)
SECURITY INTEREST Recorded Apr 17, 2026
From: RED SIX AEROSPACE INC.
To: ACQUIOM AGENCY SERVICES LLC
Reel/Frame 074402/0632 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2022
From: ROBINSON, DANIEL AUGUSTINE; BICANIC, NIKOLA VLADIMIR; SNYDER, GLENN THOMAS
To: RED SIX AEROSPACE INC.
Reel/Frame 059790/0455 →
Continuity (7)
Continuation 17085809 · Oct 30, 2020
Continuation In Part 16281513 · Feb 21, 2019
Continuation In Part 16281499 · Feb 21, 2019
Continuation In Part 16243026 · Jan 8, 2019
Provisional Application 62690363 · Jun 27, 2018
Provisional Application 62663883 · Apr 27, 2018
Related Publication 20220114911A1 · Apr 14, 2022