IP Library Granted Patent US 11,270,459
Granted Patent B2
US 11,270,459 · App. 16/854,977 · Granted Mar 8, 2022

Enterprise system augmented reality detection

Inventors: Jeffrey M. Lairsey (Round Rock, TX); Sudhir V. Shetty (Cedar Park, TX); Saurabh Kishore (Round Rock, TX); Alexander P. Rote (Hutto, TX)
Assignee: Dell Products L.P.
G06T7/74G06T7/571G06T2210/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,270,459
App. No.
16/854,977
Granted
Mar 8, 2022
Kind
B2
Abstract

A system, method, and computer-readable medium are disclosed for augmented reality detection of enterprise systems in a data center. An augmented reality view is captured of an enterprise system and objects of the enterprise system. Significant areas are detected of the enterprise. In the captured augmented reality view bounding boxes are added around the significant areas. Determination is performed of three-dimensional orientation of the significant areas. Depth of the signification areas is determined based on the three-dimensional orientation.

Claims (41)

1. A computer-implementable method for augmented reality detection of enterprise systems in a data center, the method comprising:

capturing a view of an enterprise system and objects of the enterprise system;

detecting structural areas of the enterprise system and the objects of the enterprise system;

adding bounding boxes to the view of the enterprise system representing the structural areas;

determining orientation in three-dimensional space of the structural areas;

determining depth of the structural areas based on the determined orientation in the three-dimensional space; and

providing encrypted communication via a nonce to an augmented reality detection system of information as to view, the structural areas, the orientation in the three-dimensional space of the structural areas, and the depth of the structural areas.

2. The method of claim 1 , wherein the capturing further comprises a visual capture of physical image markers on the enterprise system.

3. The method of claim 2 , wherein the visual capture incudes additional information as to the enterprise system and/or the objects of the enterprise system.

4. The method of claim 1 , wherein the detecting structural areas and adding bounding boxes is performed by an object detection model.

5. The method of claim 1 , wherein the determining orientation further comprises refining the bounding boxes representing the structural areas.

6. The method of claim 1 , wherein the determining orientation uses accelerometer data relative to the captured view.

7. The method of claim 1 , wherein the depth of the structural areas is determined using focal point of a camera that captures the view and relative received signal strength indicator (RSSI) values to an access point.

8. A system comprising:

a processor;

a data bus coupled to the processor; and

a non-transitory, computer-readable storage medium embodying computer program code, the non-transitory, computer-readable storage medium being coupled to the data bus, the computer program code interacting with a plurality of computer operations for augmented reality detection of enterprise systems in a data center and comprising instructions executable by the processor and configured for:

capturing a view of an enterprise system and objects of the enterprise system;

detecting structural areas of the enterprise system and the objects of the enterprise system;

adding bounding boxes to the view of the enterprise system representing the structural areas;

determining orientation in three-dimensional space of the structural areas;

determining depth of the structural areas based on the determined orientation in the three-dimensional space; and

providing encrypted communication via a nonce to an augmented reality detection system of information as to view, the structural areas, the orientation in the three-dimensional space of the structural areas, and the depth of the structural areas.

9. The system of claim 8 , wherein the capturing further comprises a visual capture of physical image markers on the enterprise system.

10. The system of claim 9 , wherein the visual capture incudes additional information as to the enterprise system and/or the objects of the enterprise system.

11. The system of claim 8 , wherein the detecting structural areas and adding bounding boxes is performed by an object detection model.

12. The system of claim 8 , wherein the determining orientation further comprises refining the bounding boxes representing the structural areas.

13. The system of claim 8 , wherein the determining orientation uses accelerometer data relative to the captured view.

14. The system of claim 8 , wherein the depth of the structural areas is determined using focal point of a camera that captures the view and relative received signal strength indicator (RSSI) values to an access point.

15. A non-transitory, computer-readable storage medium embodying computer program code, the computer program code comprising computer executable instructions configured for:

capturing a view of an enterprise system and objects of the enterprise system;

detecting significant areas of the enterprise system and the objects of the enterprise system;

adding bounding boxes to the view of the enterprise system representing the structural areas;

determining orientation in three-dimensional space of the structural areas;

determining depth of the structural areas based on the determined orientation in the three-dimensional space; and

providing encrypted communication via a nonce to an augmented reality detection system of information as to view, the structural areas, the orientation in the three-dimensional space of the structural areas, and the depth of the structural areas.

16. The non-transitory, computer-readable storage medium of claim 15 , wherein the capturing further comprises a visual capture of physical image markers on the enterprise system.

17. The non-transitory, computer-readable storage medium of claim 15 , wherein the detecting structural areas and adding bounding boxes is performed by an object detection model.

18. The non-transitory, computer-readable storage medium of claim 15 , wherein the determining orientation further comprises refining the bounding boxes representing the structural areas.

19. The non-transitory, computer-readable storage medium of claim 15 , wherein the determining orientation uses accelerometer data relative to the captured view.

20. The non-transitory, computer-readable storage medium of claim 15 , wherein the depth of the structural areas is determined using focal point of a camera that captures the view and relative received signal strength indicator (RSSI) values to an access point.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0081) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0441 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052851/0917) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0509 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (052852/0022) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0582 →
RELEASE OF SECURITY INTEREST AT REEL 052771 FRAME 0906 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0298 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052852/0022 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC; THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0081 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 052851/0917 →
SECURITY AGREEMENT Recorded May 28, 2020
From: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 052771/0906 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2020
From: LAIRSEY, JEFFREY M.; SHETTY, SUDHIR V.; KISHORE, SAURABH; ROTE, ALEXANDER P.
To: DELL PRODUCTS L.P.
Reel/Frame 052460/0195 →