IP Library Granted Patent US 10,572,452
Granted Patent B1
US 10,572,452 · App. 14/588,443 · Granted Feb 25, 2020

Context-based read-ahead for B+ tree data structures in a deduplication system

Inventors: Pranay Singh (Santa Clara, CA); George Mathew (Belmont, CA); Pengju Shang (Milpitas, CA)
Assignee: EMC IP Holding Company LLC
G06F16/1748G06F16/2246
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,572,452
App. No.
14/588,443
Granted
Feb 25, 2020
Kind
B1
Abstract

Embodiments are described for a method and system for improving B+Tree scan performance by receiving a data access instruction that specifies pages to be accessed in a data store utilizing a B+Tree data structure; defining a read-ahead context comprising an array of page numbers corresponding to the specified pages; loading the read-ahead context array into a read-ahead cache; and reading the first page of the read-ahead context in a synchronous manner, and each of the subsequent pages of the read-ahead context in an asynchronous manner.

Claims (22)

1. A computer-implemented method of performing deduplication backup operations of data maintained by a file system in a multi-layer deduplication backup system, comprising:

maintaining a read-ahead cache between a deduplication layer executing the deduplication backup operations in which only a single copy of each data object is stored, and a namespace layer storing a B+Tree data structure of files processed by the backup operations, wherein the B+Tree stores key-value pairs in a lowest level of a tree structure, the key-value pairs representing pointers that point to pages to be accessed in response to a backup operation;

receiving, from a user scan request requiring multiple synchronous responses by the file system to an I/O layer coupled between the deduplication layer and a storage layer containing storage devices, a data access instruction that specifies the pages to be accessed in a data store contained in the storage layer, wherein the read-ahead cache reads the pages from the I/O layer;

storing in the B+Tree, page numbers of pages following a first page of data and forming a linear set of data allowing batch processed, context-based data accesses by the backup system using both synchronous and asynchronous accesses of the data stored in the B+Tree, wherein the pages following the first page of data are catalogued by date and time of creation;

reading the first page of the pages synchronously with a scan operation performed on blocks of the files;

preparing a read-ahead context array using pointers of pointer and key pairs of the B+Tree, wherein the pointers point to respective leaf pages of the B+Tree, by loading pointers for pages after the first page based on a hint provided as user input and comprising an identification of specific subsequent pages after the first page, wherein the specific subsequent pages may not be sequential pages;

loading from the read-ahead context array, the read-ahead cache with a plurality of subsequent pages of the specific subsequent pages based on an indication of linear access based on temporal parameters, and an indication of a number of the plurality of subsequent pages after the first page as specified in the scan operation; and

reading, through I/O layer fetches, the plurality of subsequent pages asynchronously with the scan operation from the read-ahead cache, and as a single batch of pages, so as to require no waiting for acknowledgement from the I/O layer for each of the subsequent page reads in which the subsequent pages are not stored contiguously the storage devices and in which a B+Tree scan results in random reads for the deduplication backup operations.

2. The method of claim 1 wherein the read-ahead cache is configured to be of a defined size determined by the number of the plurality of subsequent pages, and wherein the read-ahead cache represents pre-fetch window for a context of the scan operation, and further wherein the indication of linear access corresponds to a respective date and time of creation for each page of the plurality of subsequent pages.

3. The method of claim 2 further comprising maintaining an array of the first and plurality of subsequent pages in the read-ahead cache in a rotating log manner.

4. The method of claim 2 wherein the read ahead context array comprises an array of page numbers prepared by loading pointers after a first scan leaf page of the B+Tree data structure.

5. The method of claim 4 wherein a number of pages obtained from the read ahead cache is equal to a read ahead window size.

6. The method of claim 5 wherein the multiple sequential pages are automatically catalogued based on a creation time and are indexed by the pointers loaded after the first scan leaf page.

7. The method of claim 4 wherein the B+Tree references data stored in the storage layer, and wherein the pages comprise a single copy of data objects stored in the data store.

8. A computer program product comprising a non-transitory computer usable medium having machine readable code embodied therein for performing deduplication backup operations of data maintained by a file system in a multi-layer deduplication backup system, by:

maintaining a read-ahead cache between a deduplication layer executing the deduplication backup operations, and a namespace layer storing a B+Tree data structure of files processed by the backup operations in which only a single copy of each data object is stored, wherein the B+Tree stores key-value pairs in a lowest level of a tree structure, the key-value pairs representing pointers that point to pages to be accessed in response to a backup operation;

receiving, from a user scan request requiring multiple synchronous responses by the file system to an I/O layer coupled between the deduplication layer and a storage layer containing storage devices, a data access instruction that specifies the pages to be accessed in a data store contained in the storage layer, wherein the read-ahead cache reads the pages from the I/O layer;

storing in the B+Tree, page numbers of pages following a first page of data and forming a linear set of data allowing batch processed, context-based data accesses by the backup system using both synchronous and asynchronous accesses of the data stored in the B+Tree, wherein the pages following the first page of data are catalogued by date and time of creation;

reading the first page of the pages synchronously with a scan operation performed on blocks of the files;

preparing a read-ahead context array using pointers of pointer and key pairs of the B+Tree, wherein the pointers point to respective leaf pages of the B+Tree, by loading pointers for pages after the first page based on a hint provided as user input and comprising an identification of specific subsequent pages after the first page, wherein the specific subsequent pages may not be sequential pages;

loading from the read-ahead context array, the read-ahead cache with a plurality of subsequent pages of the specific subsequent pages based on an indication of linear access based on temporal parameters, and an indication of a number of the plurality of subsequent pages after the first page as specified in the scan operation; and

reading, through I/O layer fetches, the plurality of subsequent pages asynchronously with the scan operation from the read-ahead cache, and as a single batch of pages, so as to require no waiting for acknowledgement from the I/O layer for each of the subsequent page reads in which the subsequent pages are not stored contiguously the storage devices and in which a B+Tree scan results in random reads for the deduplication backup operations.

Assignments (4)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 1, 2015
From: SINGH, PRANAY; MATHEW, GEORGE; SHANG, PENGJU
To: EMC CORPORATION
Reel/Frame 034610/0174 →
Cited By (12)
US 12,222,922 US 12,399,880 US 12,445,283 US 12,455,859 US 12,455,861 US 12,487,972 US 12,530,262 US 12,579,109 US 12,608,401 US 12,688,159 US 12,693,993 US 12,717,755