IP Library Granted Patent US 11,107,284
Granted Patent B2
US 11,107,284 · App. 16/456,892 · Granted Aug 31, 2021

System and method for visualization of system components

Inventors: Richard C. Deck (Austin, TX); Scott C. Lauffer (Austin, TX)
Assignee: Dell Products L.P.
G06T19/006G06F11/3447G06T19/20H04L67/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,107,284
App. No.
16/456,892
Granted
Aug 31, 2021
Kind
B2
Abstract

A system, method, and computer-readable medium for modeling and diagnosing a system. System identification information captured by an AR system is used to identify the system and one or more of a model of the components of the system or an overlay of the system is retrieved from a repository or generated based on component identification information or component performance data and sent to the AR system. A composite view of the model or overlay relative to a dynamic image or model of the system allows a technician to visualize the system and components and diagnose the operation of the system without opening the system.

Claims (64)

1. A computer-implementable method for visualizing a system within an information technology (IT) environment, comprising:

capturing system identification information by an augmented reality (AR) system;

identifying the system based on the captured system identification information, the system being contained within a rack of systems within the IT environment;

sending one of a model corresponding to a set of components associated with the identified system or an overlay based on the model to the AR system; and

displaying the model or the overlay relative to a dynamic image of the system with associated information about the system, the model or overlay presenting diagnostic information and performance information superimposed over the dynamic image of the system, the performance information including historical information regarding the system, the displaying visualizing the system without a need to remove the system from the rack of systems; and wherein

the overlay comprises a plurality of panes of component performance data, the plurality of panes associating specific respective performance parameters of the component performance data with a component of the set of components, the plurality of panes comprising a thermal pane for visualizing thermal generation and cooling by each component of the set of components, a workload pane for visualizing work performed by each component of the set of components and a power pane for visualizing power usage by each component of the set of components.

2. The method of claim 1 , wherein:

at least one of the model and the overlay is stored in a repository.

3. The method of claim 1 , further comprising:

scanning, by the AR system, the set of internal components of the system;

identifying component identification information corresponding to a set of components in the system; and

generating the model based on the component identification information.

4. The method of claim 1 , wherein:

the model is displayed when the system is closed, wherein the overlay is displayed when the system is open.

5. The method of claim 1 , wherein:

the system comprises an internal camera, and the method further comprises

accessing the internal camera;

recording the system in operation; and

displaying the recording of the operation with the model or overlay.

6. A visualization system comprising:

a processor;

a data bus coupled to the processor; and

a non-transitory, computer-readable storage medium embodying computer program code for visualizing a system within an information technology (IT) environment, the non-transitory, computer-readable storage medium being coupled to the data bus, the computer program code interacting with a plurality of computer operations and comprising instructions executable by the processor and configured for:

receiving system identification information captured by an augmented reality (AR) system;

identifying the system based on the captured system identification information, the system being contained within a rack of systems within the IT environment;

sending one of a model corresponding to a set of components associated with the identified system or an overlay based on the model to the AR system; and

displaying the model or the overlay relative to a dynamic image of the system with associated information about the system, the model or overlay presenting diagnostic information and performance information superimposed over the dynamic image of the system, the performance information including historical information regarding the system, the displaying visualizing the system without a need to remove the system from the rack of systems; and wherein

the overlay comprises a plurality of panes of component performance data, the plurality of panes associating specific respective performance parameters of the component performance data with a component of the set of components, the plurality of panes comprising a thermal pane for visualizing thermal generation and cooling by each component of the set of components, a workload pane for visualizing work performed by each component of the set of components and a power pane for visualizing power usage by each component of the set of components.

7. The visualization system of claim 6 , wherein:

at least one of the model and the overlay is stored in a repository.

8. The visualization system of claim 6 , wherein the instructions are configured for:

scanning the set of internal components of the system;

identifying component identification information corresponding to a set of components in the system; and

generating the model based on the component identification information.

9. The visualization system of claim 6 , wherein:

the model is displayed when the system is closed, wherein the overlay is displayed when the system is open.

10. The visualization system of claim 9 , wherein:

the system comprises an internal camera, and the instructions are further configured for:

accessing the internal camera;

recording the system in operation; and

displaying the recording of the operation with the model or overlay.

11. A non-transitory, computer-readable storage medium embodying computer program code for visualizing a system within an information technology (IT) environment, the computer program code comprising computer executable instructions configured for:

receiving system identification information captured by an augmented reality (AR) system;

identifying the system based on the captured system identification information, the system being contained within a rack of systems within the IT environment;

sending one of a model corresponding to a set of components associated with the identified system or an overlay based on the model to the AR system; and

displaying the model or the overlay relative to a dynamic image of the system with associated information about the system, the model or overlay presenting diagnostic information and performance information superimposed over the dynamic image of the system, the performance information including historical information regarding the system, the displaying visualizing the system without a need to remove the system from the rack of systems; and wherein

the overlay comprises a plurality of panes of component performance data, the plurality of panes associating specific respective performance parameters of the component performance data with a component of the set of components, the plurality of panes comprising a thermal pane for visualizing thermal generation and cooling by each component of the set of components, a workload pane for visualizing work performed by each component of the set of components and a power pane for visualizing power usage by each component of the set of components.

12. The non-transitory, computer-readable storage medium of claim 11 , wherein:

at least one of the model and the overlay is stored in a repository.

13. The non-transitory, computer-readable storage medium of claim 11 , wherein the computer executable instructions are further configured for:

scanning the set of internal components of the system;

identifying component identification information corresponding to a set of components in the system; and

generating the model based on the component identification information.

14. The non-transitory, computer-readable storage medium of claim 11 , wherein:

the model is displayed when the system is closed, wherein the overlay is displayed when the system is open.

15. The non-transitory, computer-readable storage medium of claim 11 , wherein:

the system comprises an internal camera, and the instructions are further configured for:

accessing the internal camera;

recording the system in operation; and

displaying the recording of the operation with the model or overlay.

16. The non-transitory, computer-readable storage medium of claim 11 , wherein:

the computer executable instructions are deployable to a client system from a server system at a remote location.

17. The non-transitory, computer-readable storage medium of claim 11 , wherein:

the computer executable instructions are provided by a service provider to a user on an on-demand basis.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0088 →
RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058213/0825 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 15, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 050724/0571 →
SECURITY AGREEMENT Recorded Sep 17, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 050406/0421 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2019
From: DECK, RICHARD C.; LAUFFER, SCOTT C.
To: DELL PRODUCTS L.P.
Reel/Frame 049625/0301 →