IP Library Granted Patent US 10,642,345
Granted Patent B2
US 10,642,345 · App. 15/786,234 · Granted May 5, 2020

Avionics maintenance training

Inventors: Chad L. Godina (Elkhart, IN); Steven S. Montgomery (Indianapolis, IN); Scott E. Crawford (Prosper, TX); Dean Allen Hoover (Noblesville, IN)
Assignee: Raytheon Company
G06F3/011G05B17/00G06F3/0482G06F3/0488G06F3/04883G06T15/20G06T19/006G09B5/06G09B5/065G06F2203/04803G06F2203/04808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,642,345
App. No.
15/786,234
Granted
May 5, 2020
Kind
B2
Abstract

A virtual training system includes a computing processor, a virtual reality (VR) headset and a sensor to determine a VR hand position. The processor is configured according to computing instructions in a memory device for displaying a first VR scene that includes a first VR object. A second VR scene is displayed within a visual portal in the first VR scene that includes a second VR object. A user VR hand image is displayed in at least one of the first VR scene and the second VR scene based upon the determined VR hand position.

Claims (53)

1. A virtual training system comprising:

a computing processor;

an VR headset to produce a virtual reality (VR) image within a VR setting;

a sensor to determine a hand position in relation to the VR headset;

wherein the processor is configured to perform a method, the method comprising:

displaying a first VR scene within the VR setting that includes a first VR object corresponding to a first real object at a first real location;

displaying a second VR scene within a visual portal in the first VR scene within the VR setting that includes a second VR object corresponding to a second real object at a second real location;

displaying a user VR hand image in at least one of the first VR scene and the second VR scene based upon the determined hand position in relation to the VR headset.

2. The virtual training system of claim 1 further including:

determining at least one of a virtual offset between the VR hand image and the first VR object and a virtual offset between the VR hand image and the second VR object.

3. The virtual training system of claim 1 ,

wherein the processor is configured to perform the method, the method further comprising:

identifying an occurrence of an event; and

in response to identifying the occurrence of the event, displaying the second VR scene within the visual portal in the first VR scene.

4. The virtual training system of claim 1 ,

wherein displaying the first VR scene within the VR setting includes displaying the first VR object in relation to a virtual position of the VR headset; and

wherein displaying the second VR scene within the visual portal in the first VR scene within the VR setting includes displaying the second VR object in relation to a virtual position of a virtual scene camera.

5. The virtual training system of claim 1 ,

wherein the processor is configured to perform the method, the method further comprising:

displaying a user VR hand image interaction with the first VR object when user VR hand image is displayed in the first VR scene; and

displaying a user VR hand image interaction with the second VR object when user VR hand image is displayed in the second VR scene.

6. A virtual training method comprising:

displaying a first VR scene within the VR setting that includes a first VR object corresponding to a first real object at a first real location;

displaying a second VR scene within a visual portal in the first VR scene within the VR setting that includes a second VR object corresponding to a second real object at a second real location; and

displaying a user VR hand image in at least one of the first VR scene and the second VR scene based upon the determined hand position in relation to the VR headset.

7. The training method of claim 6 further including:

determining at least one of a virtual offset between the VR hand image and the first VR object and a virtual offset between the VR hand image and the second VR object.

8. The training method of claim 6 further including:

identifying an occurrence of an event; and

in response to identifying the occurrence of the event, displaying the second VR scene within the visual portal in the first VR scene.

9. The training method of claim 6 further including:

displaying a user VR hand image interaction with the first VR object when user VR hand image is displayed in the first VR scene; and

displaying a user VR hand image interaction with the second VR object when user VR hand image is displayed in the second VR scene.

10. A virtual training system comprising:

a computing processor;

a display screen;

wherein the processor is configured perform a method, the method comprising:

displaying a control panel image that represents a real control panel and that includes a control panel object image that corresponds to a real control panel object;

receiving user input to the display screen to select the control panel object image;

in response to the user selection input, displaying a picture-in-picture (PIP) image in the control panel image representing a portion of the real control panel object that is not visible in the control panel image.

11. The virtual training system of claim 10 ,

wherein the processor is configured to perform the method, the method further comprising:

providing a control interface at a display screen location of the PIP image.

12. The virtual training system of claim 10 ,

wherein the processor is configured to perform the method, the method further comprising:

providing a control interface at a display screen location of the PIP image to receive a user input command; and

modifying a portion of the control panel image in response to receiving a user command at the control interface.

13. A training method comprising:

producing a virtual reality (VR) setting;

sensing a hand position in relation to the VR setting;

displaying a first VR scene within the VR setting that includes a first VR object corresponding to a first real object at a first real location;

displaying a second VR scene within a visual portal in the first VR scene within the VR setting that includes a second VR object corresponding to a second real object at a second real location;

displaying a user VR hand image in at least one of the first VR scene and the second VR scene based upon the determined hand position in relation to the VR headset.

Assignments (9)
RELEASE OF SECURITY INTEREST Recorded Mar 2, 2023
From: ALLY BANK, AS COLLATERAL AGENT
To: VERTEX AEROSPACE LLC; VECTRUS SYSTEMS CORPORATION; ADVANTOR SYSTEMS, LLC
Reel/Frame 062927/0061 →
RELEASE OF SECURITY INTEREST Recorded Mar 2, 2023
From: ROYAL BANK OF CANADA
To: VERTEX AEROSPACE LLC; VECTRUS SYSTEMS CORPORATION; ADVANTOR SYSTEMS, LLC
Reel/Frame 062927/0079 →
RELEASE OF SECOND LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENTS Recorded Mar 1, 2023
From: ROYAL BANK OF CANADA
To: VERTEX AEROSPACE LLC; VECTRUS SYSTEMS CORPORATION; ADVANTOR SYSTEMS, LLC
Reel/Frame 062903/0736 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Feb 28, 2023
From: VERTEX AEROSPACE LLC; VECTRUS SYSTEMS CORPORATION; ADVANTOR SYSTEMS, LLC; DELEX SYSTEMS, INCORPORATED; HIGGINS, HERMANSEN, BANIKAS, LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 062886/0877 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2022
From: RAYTHEON COMPANY
To: VERTEX AEROSPACE LLC
Reel/Frame 059436/0396 →
SECURITY AGREEMENT Recorded Dec 10, 2021
From: VERTEX AEROSPACE, LLC
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 058957/0428 →
SECOND LIEN SECURITY AGREEMENT Recorded Dec 7, 2021
From: VERTEX AEROSPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 058342/0027 →
FIRST LIEN SECURITY AGREEMENT Recorded Dec 7, 2021
From: VERTEX AEROSPACE LLC
To: ROYAL BANK OF CANADA
Reel/Frame 058342/0046 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2017
From: GODINA, CHAD L.; MONTGOMERY, STEVEN S.; CRAWFORD, SCOTT E.; HOOVER, DEAN ALLEN
To: RAYTHEON COMPANY
Reel/Frame 044394/0796 →
Continuity (2)
Provisional Application 62409787 · Oct 18, 2016
Related Publication 20190025905A1 · Jan 24, 2019