IP Library › Granted Patent US 10,003,649
Granted Patent B2
US 10,003,649 · App. 14/706,803 · Granted Jun 19, 2018

Systems and methods to improve read/write performance in object storage applications

Inventors: Rajesh Narayanan (San Jose, CA); Ke Xu (Vacaville, CA)
Assignee: Dell Products LP
H04L67/1097H04L67/1095H04L67/322H04L63/101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,003,649
App. No.
14/706,803
Filed
May 7, 2015
Granted
Jun 19, 2018
Kind
B2
Examiner
VU, VIET D
Art Unit
2448
USPC
709/213
Abstract

Various embodiments of the invention optimize and improve object storage performance in large-scale distributed networks. In certain embodiments, this is accomplished by taking advantage of the algorithm that determines a map that contains information about storage locations of object replica. This information directly translates to flow-information in real-time and is used by an SDN controller to generate dynamic flow information for traffic within the network. The SDN controller may apply QoS policies and assign QoS priorities to preferred traffic.

Claims (30)

1. A method to integrate Software-Defined Networking (SDN) with an object storage client to enable object-writes in an object storage cluster, the method comprising:

responsive to receiving a write request from a client, determining a flow map comprising a group of objects selected to store data associated with the write request;

sending Object Storage Device (OSD)-related information that is associated with or comprises the flow map to an SDN controller; and

generating flow entries, using the SDN controller, to control traffic in a network, the SDN controller generating the flow entries, comprising one or more prioritizations for one or more flows that result, at least in part, by executing the write request, using at least the flow map and one or more predictions of traffic in the network that result, at least in part, by executing the write request.

2. The method according to claim 1 , further comprising, in response to receiving an object from an object storage client, mapping the object to the group of objects.

3. The method according to claim 1 , wherein at least one of the one or more prioritizations of the flow entries comprises one or more Quality of Service (QoS) policies associated with real-time flow-information.

4. The method according to claim 1 , wherein generating flow entries comprises mapping the one or more rules from the flow map to the flow entries.

5. The method according to claim 1 , wherein at least one of the one or more prioritizations of the flow entries comprises prioritizing a connection between at least one of a first group comprising a client and a primary OSD and a second group comprising the primary OSD and a secondary OSD.

6. The method according to claim 1 , further comprising (primary OSD) replicating the object by writing the object into the secondary OSD.

7. The method according to claim 1 , further comprising in response to receiving written flows the SDN controller sending delete flows to one or more switches.

8. The method according to claim 1 , wherein the OSD-related information comprises write flows.

9. The method according to claim 1 , wherein the flow map identifies a primary OSD and comprises one or more rules.

10. A system to enable dynamic configuration of a network, the system comprising:

an object storage client, operating on a computing system comprising one or more processors and communicatively coupled to receive Object Storage Device (OSD)-related information about distributed storage in a network, the object storage client configured to:

determine a flow map based on groups of objects in the distributed storage that are intended to receive data related to a data request; and

send Object Storage Device (OSD)-related information associated with or comprising the flow map to an SDN controller that generates flow entries, comprising one or more prioritizations for one or more flows that result at least in part by executing the data request using at least the flow map and one or more predictions of traffic in the network that result, at least in part, by executing the data request, to control the network, at least in part, using the flow entries.

11. The system according to claim 10 , wherein the object storage client is a Ceph client.

12. The system according to claim 10 , wherein the groups of objects are located in placement groups.

13. The system according to claim 10 , further comprising a primary OSD to replicate itself by writing the groups of objects into a secondary OSD.

14. The system according to claim 10 , wherein the object storage client is configured to send at least one of a delete flow map and a flow map comprising written flows to the SDN controller.

15. A system to enable integration of distributed storage with Software-Defined Networking (SDN), the system comprising:

an object storage client operating on a computing system comprising one or more processors and communicatively coupled to receive information about distributed storage in a network and configured to determine a flow map based on a group of objects in the distributed storage and a data request; and

an SDN controller, operating on a server system comprising one or more processors and communicatively coupled to at least one network interfacing device to control network traffic, configured to:

receive the flow map; and

using at least the flow map and one or more predictions of traffic in the network that result, at least in part, by executing the data request, generate flow entries, comprising one or more prioritizations for one or more data flows that result, at least in part, by executing the data request, to control traffic in the network using the flow entries.

16. The system according to claim 15 , wherein the SDN controller is located in a server-switch architecture.

17. The system according to claim 15 , wherein the SDN controller is configured to generate Quality of Service (QoS) policies associated with real-time flow-information to prioritize one or more connections.

18. The system according to claim 17 , wherein generating the QoS policies comprises mapping one or more rules from the flow map to the flow entries.

19. The system according to claim 18 , wherein the one or more rules are based on one of a source destination IP address, a destination IP address, a port number, an ingress switch port, a VLAN, and a VxLAN.

20. The system according to claim 18 , wherein mapping the one or more rules comprises inserting Access Control List (ACL) rules into a network interface controller card, the ACL rules being associated with a connection between at least one of a first group comprising a client and a primary OSD and a second group comprising the primary OSD and a secondary OSD.

Assignments (15)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
RELEASE OF REEL 036502 FRAME 0237 (TL) Recorded Sep 14, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040028/0088 →
RELEASE OF REEL 036502 FRAME 0291 (NOTE) Recorded Sep 14, 2016
From: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040027/0637 →
RELEASE OF REEL 036502 FRAME 0206 (ABL) Recorded Sep 13, 2016
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040017/0204 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (NOTES) Recorded Aug 27, 2015
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 036502/0291 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (TERM LOAN) Recorded Aug 27, 2015
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; WYSE TECHNOLOGY L.L.C.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 036502/0237 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (ABL) Recorded Aug 27, 2015
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; WYSE TECHNOLOGY, L.L.C.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 036502/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2015
From: NARAYANAN, RAJESH; XU, KE
To: DELL PRODUCTS L.P.
Reel/Frame 035590/0913 →
Continuity (1)
Related Publication 20160330281A1 · Nov 10, 2016