IP Library › Granted Patent US 9,165,014
Granted Patent B1
US 9,165,014 · App. 13/536,358 · Granted Oct 20, 2015

Methods and apparatus for multi-resolution replication of files in a parallel computing system using semantic information

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,165,014
App. No.
13/536,358
Granted
Oct 20, 2015
Kind
B1
Abstract

Techniques are provided for storing files in a parallel computing system using different resolutions. A method is provided for storing at least one file generated by a distributed application in a parallel computing system. The file comprises one or more of a complete file and a sub-file. The method comprises the steps of obtaining semantic information related to the file; generating a plurality of replicas of the file with different resolutions based on the semantic information; and storing the file and the plurality of replicas of the file in one or more storage nodes of the parallel computing system. The different resolutions comprise, for example, a variable number of bits and/or a different sub-set of data elements from the file. A plurality of the sub-files can be merged to reproduce the file.

Claims (34)

1. A method performed by a middleware process for storing at least one sub-file generated by a distributed application in a parallel computing system, wherein said sub-file comprises a portion of a larger file, said method comprising the steps of:

obtaining semantic information describing a content of said larger file;

generating a plurality of replicas of said sub-file with different resolutions based on said semantic information using said middleware process; and

storing said sub-file and said plurality of replicas of said sub-file in one or more storage nodes of said parallel computing system.

2. The method of claim 1 , wherein said different resolutions comprise a variable number of bits.

3. The method of claim 1 , wherein said different resolutions comprise a different sub-set of data elements from said sub-file.

4. The method of claim 1 , further comprising the step of merging a plurality of said sub-files to reproduce said file.

5. The method of claim 1 , further comprising the step of processing a query using said semantic information associated with said sub-file.

6. The method of claim 1 , further comprising the step of performing analysis of said file using said semantic information associated with said sub-file.

7. The method of claim 1 , wherein said semantic information is obtained from a user.

8. The method of claim 1 , further comprising the step of storing said semantic information describing a content of said larger file with one or more of said sub-files in one or more storage nodes of said parallel computing system.

9. The method of claim 1 , wherein a replication strategy can be specified for each of a plurality of said sub-files.

10. The method of claim 1 , wherein said one or more storage nodes reside on one or more tiers of a multi-tier storage system.

11. An apparatus for storing at least one sub-file generated by a distributed application in a parallel computing system, wherein said sub-file comprises a portion of a larger file, comprising:

a memory; and

at least one hardware device operatively coupled to the memory and configured to:

obtain semantic information describing a content of said larger file;

generate a plurality of replicas of said sub-file with different resolutions based on said semantic information using a middleware process; and

store said sub-file and said plurality of replicas of said sub-file in one or more storage nodes of said parallel computing system.

12. The apparatus of claim 11 , wherein said different resolutions comprise one or more of a variable number of bits and a different sub-set of data elements from said sub-file.

13. The apparatus of claim 11 , wherein said at least one hardware device is further configured to merge a plurality of said sub-files to reproduce said file.

14. The apparatus of claim 11 , wherein said at least one hardware device is further configured to process a query using said semantic information associated with a sub-file.

15. The apparatus of claim 11 , wherein said at least one hardware device is further configured to perform analysis of said file using said semantic information associated with said sub-file.

16. The apparatus of claim 11 , wherein said at least one hardware device is further configured to store said semantic information describing a content of said larger file with one or more of said sub-files in one or more storage nodes of said parallel computing system.

17. The apparatus of claim 11 , wherein said one or more storage nodes reside on one or more tiers of a multi-tier storage system.

18. A data storage system for storing at least one sub-file generated by a distributed application in a parallel computing system, wherein said sub-file comprises a portion of a larger file, comprising:

a hardware processing unit for obtaining semantic information describing a content of said larger file and for generating a plurality of replicas of said sub-file with different resolutions based on said semantic information using a middleware process; and

a storage medium for storing said sub-file and said plurality of replicas of said sub-file in one or more storage nodes of said parallel computing system.

19. The data storage system of claim 18 , wherein said different resolutions comprise one or more of a variable number of bits and a different sub-set of data elements from said sub-file.

20. The data storage system of claim 18 , wherein said processing unit is further configured to merge a plurality of said sub-files to reproduce said file.

21. The data storage system of claim 18 , wherein said processing unit is further configured to process a query using said semantic information associated with said sub-file.

22. The data storage system of claim 18 , wherein said processing unit is further configured to perform analysis of said file using said semantic information associated with said sub-file.

23. The data storage system of claim 18 , wherein said processing unit is further configured to store said semantic information describing a content of said larger file with one or more of said sub-files in one or more storage nodes of said parallel computing system.

24. The data storage system of claim 18 , wherein said one or more storage nodes reside on one or more tiers of a multi-tier storage system.

Assignments (14)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2018
From: LOS ALAMOS NATIONAL SECURITY, LLC
To: TRIAD NATIONAL SECURITY, LLC
Reel/Frame 047446/0766 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2016
From: EMC CORPORATION
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 040203/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
CONFIRMATORY LICENSE Recorded Mar 6, 2014
From: LOS ALAMOS NATIONAL SECURITY
To: U.S. DEPARTMENT OF ENERGY
Reel/Frame 032361/0592 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVE ASSIGNORS' NAMES PREVIOUSLY RECORDED ON REEL 028987 FRAME 0916. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 15, 2013
From: FAIBISH, SORIN; BENT, JOHN M.; TZELNIC, PERCY
To: EMC CORPORATION
Reel/Frame 031016/0234 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2013
From: GRIDER, GARY; TORRES, AARON
To: LOS ALAMOS NATIONAL SECURITY, LLC
Reel/Frame 030293/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2012
From: FAIBISH, SORIN; BENT, JOHN M.; TZELNIC, PERCY; GRIDER, GARY; TORRES, AARON
To: EMC CORPORATION
Reel/Frame 028987/0916 →