Adaptive compression of stored data
Systems, devices and methods for adaptive compression of stored information includes a memory management computing device programmed to monitor a size of a plurality of data structures stored in a data repository. The computing device compares the size of each of a plurality of data structures to a predetermined threshold. When a size of an uncompressed data structure meets the threshold, the memory management computing device calculates a value of a first compression parameter based on a value of a first parameter and a value of a second parameter of each data element of the uncompressed data structure, calculates a value of a second compression parameter based the value of the first parameter of each data element of the uncompressed data structure, generates a compressed data structure based on the value of the first compression parameter and the second compression parameter; and replaces, in the data repository, the uncompressed data structure with the compressed data structure.
1 . A system comprising:
a processor and a memory coupled therewith, the memory storing instructions that when executed by the processor cause the processor to determine that data storage required to store data items, each having first and second data values resulting from an electronic transaction, exceeds a threshold, the data items being collectively characterized based on the first and second values of each data item, and automatically, based thereon, reduce the data storage required via replacement of the data items with first and, when generated, second replacement data, the first replacement data being generated based on a difference between a first value of one of the data items and a third value characterizing the data items based on the first value of each of the data items being modified as a function of the second value thereof, and the second replacement data being generated when there is a difference between the first value of the one of the plurality of data and the first replacement data so that the first and second replacement data are collectively characterized identically to the data items.
2 . The system of claim 1 , wherein the data items comprise an electronic record of results of a plurality of electronic transactions corresponding to an associated user completed prior to the determination.
3 . The system of claim 2 , wherein the instructions are further executable by the processor to cause the processor to determine, subsequent to the replacement, that another electronic transaction corresponding to the associated user has been completed and, based thereon, add data indicative thereof to the data items.
4 . The system of claim 2 , wherein each of the data items corresponds to a result of a different electronic transaction and wherein the first value of at least one of the plurality of data is different from the first value of another of the data items.
5 . The system of claim 4 , wherein each electronic transaction comprises an interest rate swap, the collective characteristic comprising a risk value.
6 . The system of claim 1 , wherein the data items are stored remote from the processor.
7 . The system of claim 1 , wherein the first value corresponds to an interest rate and the second value corresponds to a notional value.
8 . The system of claim 1 , wherein the data items are collectively characterized by a collective cash flow of the electronic transactions represented by the data items.
9 . The system of claim 1 , wherein the required data storage may be subject to a limit different from a limit to which the required data storage of other data items are subject.
10 . The system of claim 1 , wherein the data items are periodically synchronized with a remote computer system via a communications network, the first and, when generated, second replacement data taking less time to synchronize than the data items which were replaced.
11 . A computer implemented method comprising:
determining, by a processor, that data storage required to store data items, each having first and second data values resulting from an electronic transaction, exceeds a threshold, the data items being collectively characterized based on the first and second values of each data item, and automatically, based thereon, reducing the data storage required by replacing the data items with first and, when generated, second replacement data, the first replacement data being generated based on a difference between a first value of one of the data items and a third value characterizing the data items based on the first value of each of the data items being modified as a function of the second value thereof, and the second replacement data being generated when there is a difference between the first value of the one of the plurality of data and the first replacement data so that the first and second replacement data are collectively characterized identically to the data items.
12 . The computer implemented method of claim 11 , wherein the data items comprise an electronic record of results of a plurality of electronic transactions corresponding to an associated user completed prior to the determination.
13 . The computer implemented method of claim 12 , further comprising determining, by the processor subsequent to the replacement, that another electronic transaction corresponding to the associated user has been completed and, based thereon, adding data indicative thereof to the data items.
14 . The computer implemented method of claim 12 , wherein each of the data items corresponds to a result of a different electronic transaction and wherein the first value of at least one of the data items is different from the first value of another of the data items.
15 . The computer implemented method of claim 14 , wherein each electronic transaction comprises an interest rate swap, the collective characteristic comprising a risk value.
16 . The computer implemented method of claim 11 , wherein the data items are stored remote from the processor.
17 . The computer implemented method of claim 11 , wherein the first value corresponds to an interest rate and the second value corresponds to a notional value.
18 . The computer implemented method of claim 11 , wherein the data items are collectively characterized by a collective cash flow of the electronic transactions represented by the data items.
19 . The computer implemented method of claim 11 , wherein the required data storage may be subject to a limit different from a limit to which the required data storage of other data items are subject.
20 . The computer implemented method of claim 11 , wherein the data items are periodically synchronized with a remote computer system via a communications network, the first and, when generated, second replacement data taking less time to synchronize than the data items which were replaced.
21 . A memory management computing device comprising:
a processor and a memory coupled therewith, the memory storing instructions that when executed by the processor cause the processor to perform the steps of:
determining that data storage required to store data items, each having first and second data values resulting from an electronic transaction, exceeds a threshold, the data items being collectively characterized based on the first and second values of each data item, and automatically, based thereon, reducing the data storage required by replacing the data items with first and, when generated, second replacement data, the first replacement data being generated based on a difference between a first value of one of the data items and a third value characterizing the data items based on the first value of each of the data items being modified as a function of the second value thereof, and the second replacement data being generated when there is a difference between the first value of the one of the plurality of data and the first replacement data so that the first and second replacement data are collectively characterized identically to the data items.