IP Library Granted Patent US 9,996,551
Granted Patent B2
US 9,996,551 · App. 14/210,650 · Granted Jun 12, 2018

System and method for determining and maintaining object location and status

Inventors: Brian Bare (Chesapeake, VA); Jonathan Martin (Virginia Beach, VA); Paul Sells (Newport News, VA); Patrick Ryan (Carrollton, VA)
Assignee: Huntington Ingalls, Incorporated
G06F17/30241H04L67/38H04W4/043H04W12/06H04L63/0861
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,996,551
App. No.
14/210,650
Granted
Jun 12, 2018
Kind
B2
Abstract

An asset information management system is provided for obtaining and storing information on assets disposed within a structural environment. The system comprises at least one mobile interface device for capturing information about a target object in the structural environment. An information management operating system operates on a central processor in communication with the mobile interface device and a local positioning system. The domain coordinate management system comprises one or more computers configured for establishing spatial addresses for spaces and points within the structural environment. The asset log comprises one or more data storage modules configured for storing information associated with objects disposed within the structural environment. The spatial indexing engine is configured for assigning a spatial address to the target object and for storing information associated with the target object in the asset log.

Claims (46)

1. An asset information management system for obtaining and storing information on assets disposed within a physical structural environment, the system comprising:

at least one mobile interface device configured for variable disposition within a physical dynamic structure in the physical structural environment, for capturing information about a target object disposed within the physical dynamic structure, and for transmitting the target object information over a network;

a local positioning system in communication with the at least one mobile interface device via the network and configured to provide information usable to determine a mobile device pose, said mobile device pose comprising a position and orientation of the mobile interface device relative to the physical structural environment;

a central processor in communication with the at least one mobile interface device and the local positioning system via the network and having an information management operating system operating thereon, the information management operating system being configured for receiving and processing the target object information;

a domain coordinate management system comprising one or more computers configured for establishing and maintaining spatial addresses for spaces and points within the physical structural environment, for receiving first spatial address information from the local positioning system and second spatial address information from a three-dimensional model of the physical dynamic structure, and for determining differences between the first and second spatial address information resulting from spatial changes in the physical dynamic structure;

an asset log comprising one or more data storage modules configured for storing information associated with objects disposed within the physical structural environment; and

a spatial indexing engine in communication with the domain coordinate management system, the asset log and the central processor, the spatial indexing engine being configured for assigning a spatial address to the target object and for storing information associated with the target object in the asset log.

2. An asset information management system according to claim 1 , wherein the target object information captured by the mobile interface device includes information usable with the mobile device pose to determine the target object's position and orientation relative to the physical structural environment.

3. An asset information management system according to claim 1 , wherein the mobile interface device is configured for capturing an image of the target object, the image being included in the target object information.

4. An asset information management system according to claim 1 , wherein the mobile interface device is one of the set consisting of a tablet computer, a smartphone, and a wearable heads-up display.

5. An asset information management system according to claim 1 , wherein the mobile interface device is configured for capturing an image of the target object and for displaying the captured image with a superimposed computer-generated image associated with at least one of the set consisting of the target object and a portion of the physical structural environment in which the target object is disposed.

6. An asset information management system according to claim 1 , wherein the target object information includes at least one of the set consisting of an image of the target object, information on target object geometry, information on target object location, and information on target object orientation.

7. An asset information management system according to claim 1 , wherein the information associated with the target object stored in the asset log by the spatial indexing engine includes a position and an orientation of the target object relative to the physical dynamic structure.

8. An asset information management system according to claim 1 , wherein the position and orientation of the target object relative to the physical dynamic structure are determined from the mobile device pose, an image captured by the mobile device, and spatial differences resulting from changes in the physical dynamic structure.

9. An asset information management system according to claim 1 , wherein the spatial indexing engine is further configured for

receiving target object information from the central processor,

comparing the target object information to known object information stored in the asset log,

and assigning a spatial address to the target object only if the object information does not match any known object information in the asset log.

10. An asset information management system according to claim 1 , wherein the local positioning system is configured to determine the mobile device pose using pre-identified visual tracking cues within the physical structural environment.

11. A method of storing object information associated with a target object disposed within a physical structural environment, the method comprising:

positioning a mobile interface device within a portion of the physical structural environment where the target object is located, the mobile interface device having a mobile device position and orientation relative to the physical structural environment;

determining a mobile device pose comprising the mobile device position and orientation relative to the physical structural environment;

capturing object information with the mobile interface device;

receiving at a central data processor the mobile device pose and the object information from the mobile interface device;

determining a location and orientation of the object relative to the physical structural environment, accounting for spatial changes in the physical structural environment;

adding the location and orientation of the object to the object information;

comparing the object information to information stored in an asset log database;

determining whether the object is recognized based on results of the comparing action;

responsive to determining that the object is recognized, updating information on the object in the asset log database; and

responsive to determining the object is not recognized,

assigning a spatial address to the object, and

storing the object information as a new entry in the asset log database.

12. A method according to claim 11 wherein the action of capturing object information includes:

capturing an image of the object.

13. A method according to claim 12 wherein the action of capturing object information further includes:

applying object recognition techniques to the object image to provide an object recognition result; and

adding the object recognition result to the object information.

14. A method according to claim 11 wherein the action of determining a location and orientation of the object relative to the physical structural environment-includes:

determining first spatial address information for the object using the object information and information from a local positioning system;

determining second spatial address information for the object using a three-dimensional model of the physical dynamic structure; and

determining differences between the first and second spatial address information resulting from changes in the physical structural environment.

15. A method according to claim 11 wherein the location and orientation of the object are determined at least in part from the mobile device pose and an image captured by the mobile interface device.

16. A method according to claim 11 wherein the object information includes at least one of the set consisting of an image of the object, a geometry of the object, and information from a tag attached to the object.

17. A method according to claim 11 further comprising:

transmitting the object information by the mobile interface device over a wireless communication network.

18. A method according to claim 11 wherein the action of updating information on the object in the asset log database includes noting changes in at least one of the set consisting of object location, object orientation, and object status.

Assignments (3)
RELEASE OF SECURITY INTEREST Recorded Dec 7, 2017
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: HUNTINGTON INGALLS INCORPORATED (F/K/A NORTHROP GRUMMAN SHIPBUILDING, INC.)
Reel/Frame 044325/0332 →
PATENT SECURITY AGREEMENT Recorded Jul 13, 2015
From: HUNTINGTON INGALLS INCORPORATED
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 036099/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2014
From: BARE, BRIAN; MARTIN, JONATHAN; RYAN, PATRICK; SELLS, PAUL
To: HUNTINGTON INGALLS, INC.
Reel/Frame 032922/0718 →
Continuity (4)
Provisional Application 61787780 · Mar 15, 2013
Provisional Application 61787966 · Mar 15, 2013
Provisional Application 61788104 · Mar 15, 2013
Related Publication 20140280199A1 · Sep 18, 2014