Optimized decompression using annotated back buffer
View Patent ↗A system and method for decompression optimization employing a data input and a dedicated back buffer and data parser. The system and method also relate to accelerating the parsing process during decompression of a block of data by taking advantage of those naturally occurring redundancies within the block of data identified at compression time. The system of the invention includes a parser and an annotated back buffer which operate collectively to optimize the parsing process during decompression.
1. A computer based system for processing data during decompression, comprising:
a back buffer for receiving a data stream, wherein the data stream comprises one or more data segments;
a parser module for generating parsed forms within the back buffer for one or more encountered data segments of the data stream;
an annotation storage means for storing annotation information, wherein the annotation information comprises a representation of a parsed form for a data segment and location information within the back buffer for a generated parsed form of the data segment; and
referencing means for referencing the annotation information to obtain the parsed form for an occurrence of a previously encountered data segment within the data stream.
2. The system of claim 1 , wherein the data stream includes a structured data array.
3. The system of claim 2 , wherein structured data array includes tag information.
4. The system of claim 2 , wherein the data stream includes a raw binary data stream.
5. The system of claim 2 , wherein the location information comprises an offset and length pair reference into the structured data array.
6. A computer based method for processing data during decompression, comprising:
receiving a data stream at a back buffer, wherein the data stream comprises one or more data segments;
generating parsed forms within the back buffer for the one or more data encountered segments of the data stream;
storing annotation information, wherein the annotation information comprises a representation of a parsed form for a data segment and location information within the back buffer for a generated parsed form of the data segment; and
referencing the annotation information to obtain the parsed form for an occurrence of a previously encountered data segment within the data stream.
7. The system of claim 6 , wherein the data stream includes a structured data array.
8. The system of claim 7 , wherein structured data array includes tag information.
9. The system of claim 7 , wherein the data stream includes a raw binary data stream.
10. The system of claim 7 , wherein the location information comprises an offset and length pair reference into the structured data array.
11. A computer based method for optimizing the parsing process for decompression, comprising:
parsing a first data segment to generate a first parsed form;
storing the first parsed form in association with a first annotation;
encountering a next data segment;
determining if the next data segment is a reference to the first data segment; and
if so, then re-using the first parsed form associated with the first annotation to represent the next data segment; or
if not, then parsing the next data segment to generate a next parsed form; and storing the next parsed form in association with a next annotation.