IP Library Granted Patent US 10,410,331
Granted Patent B2
US 10,410,331 · App. 15/280,061 · Granted Sep 10, 2019

Computed tomography object inspection system

Inventors: Edward Steven Jimenz, Jr. (Albuquerque, NM); Rahul Nunna (Fresno, CA); Tod Tracy Amon (Sandia Park, NM); Kyle R. Thompson (Albuquerque, NM)
Assignee: National Technology & Engineering Solutions of Sandia, LLC
G06T7/0004G06F3/04815G06T19/00G06T7/001G06T2200/04G06T2200/24G06T2207/10072G06T2207/10081G06T2207/10104G06T2207/10108G06T2207/30108G06T2207/30164G06T2219/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,410,331
App. No.
15/280,061
Granted
Sep 10, 2019
Kind
B2
Abstract

A method and apparatus for inspecting an object in a virtual reality environment. Computed tomography scan data for the object is identified. A first group of dimensions for a model of the object and a second group of dimensions for the computed tomography scan data for the object are adjusted such that the first group of dimensions for a first group of features in the model corresponds to the second group of dimensions for a second group of features in the computed tomography scan data. The model and the computed tomography scan data are displayed by a game engine in the virtual reality environment on a display system. Graphical indicators in the virtual reality environment are displayed when a difference is present between features in the model and the features in the computed tomography scan data, enabling identifying the difference between the object and the model of the object.

Claims (37)

1. A method for inspecting an object in a virtual reality environment, the method comprising:

identifying, by a computer system, computed tomography scan data for the object;

adjusting, by the computer system, a first group of dimensions for a model of the object and a second group of dimensions for the computed tomography scan data for the object such that the first group of dimensions for a first group of features in the model corresponds to the second group of dimensions for a second group of features in the computed tomography scan data for the object;

displaying, by a game engine running on the computer system, the model of the object and the computed tomography scan data for the object in the virtual reality environment on a display system, wherein different images are displayed to each eye of an operator such that a three-dimensional view of the model of the object and the computed tomography scan data for the object is presented in the virtual reality environment;

determining a difference between the first group of features in the model and the second group of features in the computed tomography scan data;

displaying, by the game engine running on the computer system, a group of graphical indicators in the virtual reality environment based on the difference between the first group of features in the model and the second group of features in the computed tomography scan data, wherein the group of graphical indicators indicates the difference between the second group of features in the computed tomography scan data and the first group of features in the model; and

performing an operation on the object based on the difference between the first group of features in the model and the second group of features in the computed tomography scan data.

2. The method of claim 1 further comprising:

scanning the object with a computed tomography scanner.

3. The method of claim 2 , wherein the computed tomography scanner is selected from one of an X-ray computed tomography (X-ray CT) scanner, a positron emission tomography (PET) scanner, and a single-photon emission computed tomography (SPECT) scanner.

4. The method of claim 1 , wherein displaying the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system comprises:

displaying the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system, wherein the model and the computed tomography scan data are overlaid with each other.

5. The method of claim 1 , wherein displaying the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system comprises:

displaying the model of the object and the computed tomography scan data for the object in the virtual reality environment on a display system, wherein the model and the computed tomography scan data are displayed adjacent to each other.

6. The method of claim 1 , wherein the model is a computer-aided design model and further comprising:

converting a first format for the computer-aided design model into a second format used by the game engine that displays the virtual reality environment prior to displaying the model of the object in the virtual reality environment.

7. The method of claim 1 further comprising:

removing a noise in the computed tomography scan data for the object.

8. The method of claim 1 , wherein the first group of features and the second group of features are selected from at least one of a part, a protrusion, a hole, an angle, a wire, a trace line, a pin, a surface of a structure, a component, a cable, a motor, an integrated circuit chip, a panel, a joint, and a seam.

9. An object inspection system comprising:

a display system; and

an analyzer, embodied in hardware, configured to identify a computed tomography scan data for an object; adjust a first group of dimensions for a model of the object and a second group of dimensions for the computed tomography scan data for the object such that the first group of dimensions for a first group of features in the model correspond to the second group of dimensions for a second group of features in the computed tomography scan data for the object; display the model of the object and the computed tomography scan data for the object in a virtual reality environment on the display system, wherein different images are displayed to each eye of an operator such that a three-dimensional view of the model of the object and the computed tomography scan data for the object is presented in the virtual reality environment; determine a difference between the first group of features in the model and the second group of features in the computed tomography scan data; and display a group of graphical indicators in the virtual reality environment based on the difference between the first group of features in the model and the second group of features in the computed tomography scan data, wherein the group of graphical indicators indicates the difference between the second group of features in the computed tomography scan data and the first group of features in the model, wherein based on difference between the first group of features in the model and the second group of features in the computed tomography scan data an operation is performed.

10. The object inspection system of claim 9 further comprising:

scanning the object with a computed tomography scanner.

11. The object inspection system of claim 10 , wherein the computed tomography scanner is selected from one of an X-ray computed tomography scanner (X-ray CT), a positron emission tomography (PET) scanner, and a single-photon emission computed tomography (SPECT) scanner.

12. The object inspection system of claim 9 , wherein in displaying the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system, the analyzer is configured to display the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system, wherein the model and the computed tomography scan data are overlaid with each other.

13. The object inspection system of claim 9 , wherein in displaying the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system, the analyzer is configured to display the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system, wherein the model and the computed tomography scan data are displayed adjacent to each other.

14. The object inspection system of claim 9 , wherein the model is a computer-aided design model and wherein the analyzer is configured to convert a first format for the computer-aided design model into a second format used by a game engine that displays the virtual reality environment prior to displaying the model of the object in the virtual reality environment.

15. The object inspection system of claim 9 , wherein the analyzer is configured to remove noise in the computed tomography scan data for the object.

16. The object inspection system of claim 9 , wherein the first group of features and the second group of features are selected from at least one of a surface of a structure, a component, a cable, a motor, an integrated circuit chip, a panel, a joint, a seam, and a wire.

17. An object inspection system comprising:

a computed tomography scanner that is configured to generate computed tomography scan data for an object;

a display system; and

an analyzer embodied in hardware, configured to adjust a first group of dimensions for a model of the object and a second group of dimensions for the computed tomography scan data for the object such that the first group of dimensions for a first group of features in the model correspond to a second group of dimensions for a second group of features in the computed tomography scan data for the object; display the model of the object and the computed tomography scan data for the object in a virtual reality environment on the display system using a game engine, wherein different images are displayed to each eye of an operator such that a three-dimensional view of the model of the object and the computed tomography scan data for the object is presented in the virtual reality environment; determine a difference between the first group of features in the model and the second group of features in the computed tomography scan data; and display a group of graphical indicators in the virtual reality environment using the game engine based on the difference between the first group of features in the model and the second group of features in the computed tomography scan data, wherein the group of graphical indicators indicates the difference between the second group of features in the computed tomography scan data and the first group of features in the model, wherein based on the difference between the first group of features in the model and the second group of features in the computed tomography scan data an operation is performed.

18. The object inspection system of claim 17 , wherein the analyzer is configured to control a computed tomography scanner to scan the object.

19. The object inspection system of claim 17 , wherein the model is a computer-aided design model and wherein the analyzer is configured to convert a first format for the computer-aided design model into a second format used by an engine that displays the virtual reality environment prior to displaying the model of the object in the virtual reality environment.

20. The object inspection system of claim 17 , wherein in displaying the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system, the analyzer is configured to display the model of the object and the computed tomography scan data for the object in the virtual reality environment on the display system using the game engine, wherein the model and the computed tomography scan data are displayed adjacent to each other.

Assignments (3)
CHANGE OF NAME Recorded Jul 24, 2019
From: SANDIA CORPORATION
To: NATIONAL TECHNOLOGY & ENGINEERING SOLUTIONS OF SANDIA, LLC
Reel/Frame 049847/0448 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2016
From: NUNNA, RAHUL
To: SANDIA CORPORATION
Reel/Frame 040338/0209 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2016
From: JIMENEZ, EDWARD STEVE, JR; AMON, TOD TRACY; THOMPSON, KYLE R.
To: SANDIA CORPORATION
Reel/Frame 040276/0614 →
Continuity (1)
Related Publication 20180089819A1 · Mar 29, 2018
Cited By (1)
US 12,283,040