IP Library Granted Patent US 11,768,612
Granted Patent B2
US 11,768,612 · App. 17/160,574 · Granted Sep 26, 2023

System and method for distributed deduplication in a composed system

Inventor: Yossef Saad (Ganei Tikva, IL)
Assignee: Dell Products L.P.
G06F3/0623G06F3/0631G06F3/0641G06F3/0673G06F9/5011G06F9/5077G06F16/2255
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,768,612
App. No.
17/160,574
Granted
Sep 26, 2023
Kind
B2
Abstract

A system for managing composed information handling systems to provide data protection services for data generated by applications hosted by the composed information handling systems, includes a processor that executes applications and a system control processor manager that obtains a composition request for a composed information handling system, identifies a compute resource set having compute resources specified by the composition request, identifies a hardware resource set having hardware resources specified by the composition request, sets up storage management services for managing reads and writes of data the hardware resource set using a control resource set, which performs deduplication on data generated by the applications, to obtain logical hardware resources, and presents the logical hardware resources using the control resource set to the compute resource set as bare metal resources to instantiate a composed information handling system to service the composition request.

Claims (85)

1. A system for managing composed information handling systems to provide data protection services for data generated by applications hosted by the composed information handling systems, comprising:

a processor that executes an application of the applications; and

a system control processor manager programmed to:

obtain a composition request for a composed information handling system, wherein the composition request specifies data protection services to be provided to the composed information handling system for data generated by the application hosted by the composed information handling system;

identify at least one compute resource set having compute resources specified by the composition request;

identify at least one hardware resource set having hardware resources specified by the composition request;

setup, based on the composition request, storage management services for managing reads and writes of the data to the at least one hardware resource set using an at least one control resource set to obtain logical hardware resources, wherein setting up the storage management services comprises:

instantiating a central data protection manager using additional computing resources, wherein the central data protection manager performs a first portion of the data protection services comprising maintaining a hash repository associated with storage resources of the at least one hardware resource set;

registering the at least one control resource set with the central data protection manager; and

preparing the at least one control resource set to perform a second portion of the data protection services using the central data protection manager, wherein the second portion of the data protection services comprises performing deduplication, encryption, and compression on data chunks of the data generated by the application; and

present the logical hardware resources using the at least one control resource set to the at least one compute resource set as bare metal resources to instantiate the composed information handling system to service the composition request.

2. The system of claim 1 , wherein setting up storage management services for managing reads and writes of the data to the at least one hardware resource set using an at least one control resource set to obtain logical hardware further comprises:

prior to instantiating the central data protection manager:

making a determination that the central data protection manager is not currently in the system; and

in response to the determination:

identifying the additional computing resources to instantiate the central data protection manager.

3. The system of claim 2 , wherein the at least one control resource set comprises a system control processor.

4. The system of claim 3 , wherein the second portion of the data protection services comprises:

obtaining a bare metal communication associated with a write of the data generated by the application;

generating the data chunks using the data;

generating hashes of the data chunks;

identifying data chunks not included in the storage resources of the at least one hardware resource set using the hashes and the central data protection manager; and

performing the second portion of the data protection services on the identified data chunks.

5. The system of claim 4 , wherein identifying data chunks not included in the storage resources of the at least one hardware resource set using the hashes and the central data protection manager comprises:

sending a request to identify a portion of the hashes associated with data chunks not already stored in the storage resources, wherein the request includes the hashes; and

obtaining a message that specifies the hashes associated with the data chunks not already stored in the storage resources.

6. The system of claim 4 , wherein performing the second portion of the data protection services further comprises:

storing the data chunks in a storage resource of the at least one hardware resource set; and

notifying the central data protection manager of storage locations of the data chunks.

7. The system of claim 4 , wherein performing the second portion of the data protection services further comprises:

performing data compression on data generated by applications executing on the at least one compute resource set to generate compressed data chunks;

storing the compressed data chunks in a storage resource of the at least one hardware resource set; and

notifying the central data protection manager of storage locations of the compressed data chunks.

8. The system of claim 4 , wherein the second portion of the data protection services further comprises:

obtain a bare metal communication associated with a read of data from the application;

identify storage locations of data chunks associated with the bare metal communication using the central data protection manager;

obtain the data chunks from at least one storage resource of the at least one hardware resource set and rebuild the data using the data chunks; and

send the rebuilt data to the application.

9. The system of claim 8 , wherein identifying storage locations of data chunks associated with the bare metal communication using the central data protection manager comprises:

sending a request to identify the storage locations of the data chunks associated with the bare metal communication; and

obtaining a message that specifies the storage locations of the data chunks associated with the bare metal communication.

10. The system of claim 8 , wherein the central data protection manager comprises at least one storage resource, wherein the at least one storage resource comprises storage information and hash repository.

11. The system of claim 10 , wherein the storage information comprises the hash repository that specifies the hashes of data chunks stored in the composed information handling system and storage locations associated with the hashes.

12. A method for managing composed information handling systems to provide data protection services for data generated by applications hosted by the composed information handling systems, comprising:

obtaining a composition request for a composed information handling system, wherein the composition request specifies data protection services to be provided to a composed information handling system for data generated by an application hosted by the composed information handling system;

identifying at least one compute resource set having compute resources specified by the composition request;

identifying at least one hardware resource set having hardware resources specified by the composition request;

setting up, based on the composition request, storage management services for managing reads and writes of the data to the at least one hardware resource set using an at least one control resource set to obtain logical hardware resources, wherein setting up the storage management services comprises:

instantiating a central data protection manager using additional computing resources, wherein the central data protection manager performs a first portion of the data protection services comprising maintaining a hash repository associated with storage resources of the at least one hardware resource set;

registering the at least one control resource set with the central data protection manager; and

preparing the at least one control resource set to perform a second portion of the data protection services using the central data protection manager, wherein the second portion of the data protection services comprises performing deduplication, encryption, and compression on data chunks of the data generated by the application; and

presenting the logical hardware resources using the at least one control resource set to the at least one compute resource set as bare metal resources to instantiate the composed information handling system to service the composition request.

13. The method of claim 12 , wherein setting up storage management services for managing reads and writes of the data to the at least one hardware resource set using an at least one control resource set to obtain logical hardware further comprises:

prior to instantiating the central data protection manager:

making a determination that the central data protection manager is not currently in the composed information handling system; and

in response to the determination:

identifying the additional computing resources to instantiate the central data protection manager.

14. The method of claim 13 , wherein the at least one control resource set comprises a system control processor.

15. The method of claim 14 , wherein the second portion of the data protection services comprises:

obtaining, by the system control processor, a bare metal communication associated with a write of the data generated by the application;

generating the data chunks using the data;

generating hashes of the data chunks;

identifying data chunks not included in the storage resources of the at least one hardware resource set using the hashes and the central data protection manager; and

performing the second portion of the data protection services on the identified data chunks.

16. A non-transitory computer readable medium comprising computer readable program code, which when executed by a computer processor enables the computer processor to perform a method for managing composed information handling systems to provide data protection services for data generated by applications hosted by the composed information handling systems, the method comprising:

obtaining a composition request for a composed information handling system, wherein the composition request specifies data protection services to be provided to a composed information handling system for data generated by an application hosted by the composed information handling system;

identifying at least one compute resource set having compute resources specified by the composition request;

identifying at least one hardware resource set having hardware resources specified by the composition request;

setting up, based on the composition request, storage management services for managing reads and writes of the data to the at least one hardware resource set using an at least one control resource set to obtain logical hardware resources, wherein setting up the storage management services comprises:

instantiating a central data protection manager using additional computing resources, wherein the central data protection manager performs a first portion of the data protection services comprising maintaining a hash repository associated with storage resources of the at least one hardware resource set;

registering the at least one control resource set with the central data protection manager; and

preparing the at least one control resource set to perform a second portion of the data protection services using the central data protection manager, wherein the second portion of the data protection services comprises performing deduplication, encryption, and compression on data chunks of the data generated by the application; and

presenting the logical hardware resources using the at least one control resource set to the at least one compute resource set as bare metal resources to instantiate the composed information handling system to service the composition request.

17. The non-transitory computer readable medium of claim 16 , wherein setting up storage management services for managing reads and writes of the data to the at least one hardware resource set using an at least one control resource set to obtain logical hardware comprises:

prior to instantiating the central data protection manager:

making a determination that the central data protection manager is not currently in the composed information handling system; and

in response to the determination:

identifying the additional computing resources to instantiate the central data protection manager.

18. The non-transitory computer readable medium of claim 17 , wherein the at least one control resource set comprises a system control processor.

19. The non-transitory computer readable medium of claim 18 , wherein the second portion of the data protection services comprises:

obtaining, by the system control processor, a bare metal communication associated with a write of the data generated by the application;

generating the data chunks using the data;

generating hashes of the data chunks;

identifying data chunks not included in the storage resources of the at least one hardware resource set using the hashes and the central data protection manager; and

performing the second portion of the data protection services on the identified data chunks.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (055479/0342) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0460 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (055479/0051) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0663 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (056136/0752) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0771 →
RELEASE OF SECURITY INTEREST AT REEL 055408 FRAME 0697 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0553 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 056136/0752 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 055479/0051 →
SECURITY INTEREST Recorded Mar 3, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 055479/0342 →
SECURITY AGREEMENT Recorded Feb 25, 2021
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 055408/0697 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2021
From: SAAD, YOSSEF
To: DELL PRODUCTS L.P.
Reel/Frame 055111/0625 →
Continuity (1)
Related Publication 20220236893A1 · Jul 28, 2022