Managing data processing efficiency, and applications thereof
Disclosed herein are system, method, and computer program product embodiments for linking data records in memory. The system, method, and computer program product includes accessing a first record stored in memory, the first record holding information describing a first person and accessing at least one additional record stored in memory, the additional records holding information describing additional persons. The method continues by parsing the information of the first record and additional record and assigning the parsed information to predefined categories within the respective records. After assigning the information into categories, a similarity score between categorical information in the first record and categorical information of additional records is determined. A category of an additional record is then modified based on the similarity score, so the additional record is associated with the first person.
1. A computer-implemented method, comprising:
accessing, by one or more processors, a data record describing an individual;
assigning, by the one or more processors, the data record to a predetermined category;
comparing, by the one or more processors, the categorized data record against other data records stored in a database using a pair-wise function in order to determine whether the categorized data record should be linked, grouped, or modified to mirror an identity described by a separate data record of the other data records;
entering, by the one or more processors and into a training system, the categorized data record;
training, by the one or more processors, the training system using the categorized data record to find further individuals possessing similar demographic data as the individual to which the data record belongs;
finding, by the one or more processors, the further individuals by accessing further data records of individuals and processing the further data records using the trained training system; and
predicting, by the one or more processors, future behaviors of the further individuals based on an order of similarity between data records of the further individuals and the individual.
2. The method of claim 1 , wherein the data record comprises: income data, consumer data, web-browsing data, or an individual's mortgage history.
3. The method of claim 2 , further comprising linking, grouping, or modifying, by the one or more processors, the categorized data record to the separate data record when the pair-wise function results in a similarity score exceeding a predetermined threshold.
4. A non-transitory computer readable medium storing instructions, that when executed by one or more processors, cause the one or more processors to perform operations comprising:
accessing a data record describing an individual;
assigning the data record to a predetermined category;
comparing the categorized data record against other data records stored in a database using a pair-wise function in order to determine whether the categorized data record should be linked, grouped, or modified to mirror the identity described by a separate data record of the other data records;
entering, into a training system, the categorized data record;
training the training system using the categorized data record to find further individuals possessing similar demographic data as an individual to which the data record belongs;
finding the further individuals by accessing further data records of individuals and processing the further data records using the trained training system; and
predicting future behaviors of the further individuals based on an order of similarity between data records of the further individuals and the individual.
5. The non-transitory computer readable medium of claim 4 , wherein the data record comprises: income data, consumer data, web-browsing data, or an individual's mortgage history.
6. The non-transitory computer readable medium of claim 4 , wherein the operations further comprise linking, grouping, or modifying the categorized data record to the separate data record when the pair-wise function results in a similarity score exceeding a predetermined threshold.
7. A computing system, comprising:
a memory storing instructions;
one or more processors, coupled to the memory, configured to process the stored instructions to:
access a data record describing an individual;
assign the data record to a predetermined category;
compare the categorized data record against other data records stored in a database using a pair-wise function in order to determine whether the categorized data record should be linked, grouped, or modified to mirror an identity described by a separate data record of the other data records;
enter, into a training system, the categorized data record; and
train the training system using the categorized data record to find further individuals possessing similar demographic data as the individual to which the data record belongs;
find the further individuals by accessing further data records of individuals and processing the further data records using the trained training system;
predict future behaviors of the further individuals based on an order of similarity between data records of the further individuals and the individual.
8. The computing system of claim 7 , wherein the data record comprises: income data, consumer data, web-browsing data, or an individual's mortgage history.
9. The computing system of claim 7 , wherein the one or more processors are further configured to:
link, group, or modify the categorized data record to the separate data record when the pair-wise function results in a similarity score exceeding a predetermined threshold.