Granted Patent B2

US 12,632,419 · App. 18/785,663 · Granted May 19, 2026

Inventors: Yin Xie (Bellevue, WA); Ahmed Hassan Mohamed (Bellevue, WA); Danilo Landucci Benzatti (Seattle, WA)

Assignee: Microsoft Technology Licensing, LLC

G06F16/1744G06F16/182

Abstract

Claims (70)

1 . A method comprising:

receiving a plurality of data signals corresponding to a user, the plurality of data signals comprising a plurality of user raw records at corresponding time values;

compressing the plurality of data signals using an incremental compression algorithm to form a single compressed iterative record by generating, for each data signal, a compressed chunk and appending the compressed chunk to the end of an existing single compressed iterative record without decompressing the existing single compressed iterative record;

organizing the single compressed iterative record into hierarchical segments based on predefined time intervals using a waterfall data model; and

storing the single compressed iterative record in a first cloud storage system.

2 . The method of claim 1 , further comprising:

receiving new user data corresponding to the user;

applying the incremental compression algorithm to compress the new user data and generate a compressed new user data;

retrieving the single compressed iterative record corresponding to the user from the first cloud storage system;

generating an updated single compressed iterative record by appending the compressed new user data to the single compressed iterative record without decompressing the single compressed iterative record; and

replacing the single compressed iterative record with the updated single compressed iterative record in the first cloud storage system.

3 . The method of claim 2 , further comprising:

storing the updated single compressed iterative record in one or more of a plurality of data lakes in a second cloud storage system, each data lake providing the updated compressed iterative record to a corresponding processing application, the processing application comprising one of a time-based intelligence data analytics service application or an offline processing service application.

4 . The method of claim 2 , further comprising:

storing the updated single compressed iterative record in a second cloud storage system,

wherein the first cloud storage system is associated with a substrate domain of the user,

wherein the second cloud storage system is associated with a plurality of domains.

5 . The method of claim 2 , further comprising:

storing the updated single compressed iterative record in a data lake of a second cloud storage system,

wherein the second cloud storage system comprises a large-scale data storage processor and analytics service application,

wherein the large-scale data storage processor and analytics service application are configured to unzip the updated single compressed iterative record in runtime, process the unzipped data, and keep the updated single compressed iterative record stored in a zipped format.

6 . The method of claim 1 , further comprising:

aggregating multiple data signals into a batch before compressing,

wherein compressing the plurality of data signals includes compressing the multiple data signals in the batch.

7 . The method of claim 1 , wherein the single compressed iterative record is maintained in a just-in-time dynamic state for an accessible state without preconfiguring the plurality of data signals for a specific analytics application.

8 . The method of claim 1 , further comprising:

providing on-demand decompression and analysis of selected data segments to support real-time analytics and dynamic decision-making processes.

9 . The method of claim 1 , further comprising:

retrieving a specific segment of the single compressed iterative record from the first cloud storage system and decompressing only the retrieved segment for analysis; and

detecting changes in incoming data signals and applying the changes incrementally to the single compressed iterative record without full decompression.

10 . The method of claim 1 , further comprising:

indexing segments of the single compressed iterative record for expediting search and retrieval processes, wherein the single compressed iterative record is stored in a format that minimizes storage space requirements,

wherein the format indicates a combination of a signal type value, a start time value, an end time value, a application identifier value, a compliance value, an actor value, an item value, compressed signal values, or compact format values.

11 . A computing apparatus comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the apparatus to perform operations comprising:

receive a plurality of data signals corresponding to a user, the plurality of data signals comprising a plurality of user raw records at corresponding time values;

compress the plurality of data signals using an incremental compression algorithm to form a single compressed iterative record by generating, for each data signal, a compressed chunk and appending the compressed chunk to the end of an existing single compressed iterative record without decompressing the existing single compressed iterative record;

organize the single compressed iterative record into hierarchical segments based on predefined time intervals using a waterfall data model; and

store the single compressed iterative record in a first cloud storage system.

12 . The computing apparatus of claim 11 , wherein the instructions further configure the apparatus to:

receive new user data corresponding to the user;

apply the incremental compression algorithm to compress the new user data and generate a compressed new user data;

retrieve the single compressed iterative record corresponding to the user from the first cloud storage system;

generate an updated single compressed iterative record by appending the compressed new user data to the single compressed iterative record without decompressing the single compressed iterative record; and

replace the single compressed iterative record with the updated single compressed iterative record in the first cloud storage system.

13 . The computing apparatus of claim 12 , wherein the instructions further configure the apparatus to:

store the updated single compressed iterative record in one or more of a plurality of data lakes in a second cloud storage system, each data lake providing the updated compressed iterative record to a corresponding processing application, the processing application comprising one of a time-based intelligence data analytics service application or an offline processing service application.

14 . The computing apparatus of claim 13 , wherein the instructions further configure the apparatus to:

store the updated single compressed iterative record in the second cloud storage system,

wherein the first cloud storage system is associated with a substrate domain of the user,

wherein the second cloud storage system is associated with a plurality of domains.

15 . The computing apparatus of claim 12 , wherein the instructions further configure the apparatus to:

store the updated single compressed iterative record in a data lake of a second cloud storage system,

wherein the second cloud storage system comprises a large-scale data storage processor and analytics service application,

wherein the large-scale data storage processor and analytics service application are configured to unzip the updated single compressed iterative record in runtime, process the unzipped data, and keep the updated single compressed iterative record stored in a zipped format.

16 . The computing apparatus of claim 11 , wherein the instructions further configure the apparatus to:

aggregate multiple data signals into a batch before compressing,

wherein compress the plurality of data signals includes compressing the multiple data signals in the batch.

17 . The computing apparatus of claim 11 , wherein the single compressed iterative record is maintained in a just-in-time dynamic state for an accessible state without preconfiguring the plurality of data signals for a specific analytics application.

18 . The computing apparatus of claim 11 , wherein the instructions further configure the apparatus to:

provide on-demand decompression and analysis of selected data segments to support real-time analytics and dynamic decision-making processes.

19 . The computing apparatus of claim 11 , wherein the instructions further configure the apparatus to:

retrieve a specific segment of the single compressed iterative record from the first cloud storage system and decompressing only the retrieved segment for analysis; and

detect changes in incoming data signals and applying the changes incrementally to the single compressed iterative record without full decompression.

20 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

receive a plurality of data signals corresponding to a user, the plurality of data signals comprising a plurality of user raw records at corresponding time values;

compress the plurality of data signals using an incremental compression algorithm to form a single compressed iterative record by generating, for each data signal, a compressed chunk and appending the compressed chunk to the end of an existing single compressed iterative record without decompressing the existing single compressed iterative record;

organize the single compressed iterative record into hierarchical segments based on predefined time intervals using a waterfall data model; and

store the single compressed iterative record in a first cloud storage system.

Assignments (1)

Continuity (1)

References Cited (16)