System and methods for determining preferred data sources using data quality scores
Systems, apparatuses, methods, and computer program products are disclosed for obtaining data. The data may be obtained from a variety of data sources. In order to determine the preferred data source for obtaining the data, data quality scores may be computed and assigned to each data source of interest for a given implementation. Each data quality score may take into account several criteria including the computing resources required to obtain the data, the financial cost of obtaining the data, the security risk of obtaining the data, etc. Data may be obtained from the preferred data source, presented to a user associated with the data for verification, and processed in order to provide a computer-implemented services to the user.
1. A method for obtaining data, the method comprising:
identifying, by a data source management circuitry of an information manager, a data requirement event;
identifying, by the data source management circuitry, an internal source of data relevant to the data requirement event;
computing, by the data source management circuitry, a data quality score for the internal source of the data, wherein the data quality score is based on at least one of a computational metric or a security metric associated with the internal source of the data;
computing, by the data source management circuitry, a second data quality score for a third-party source, wherein the second data quality score is based on at least one of a computational metric or a security metric associated with the third-party source;
determining, by the data source management circuitry, an entity associated with a preferred source of data based (a) on the data quality score and (b) the second data quality score, wherein the entity is the internal source of the data or the third-party source;
obtaining, by the data source management circuitry, the data from the entity; and
providing, by a services circuitry of the information manager, computer-implemented services based on the data.
2. The method of claim 1 , wherein identifying the internal source of the data comprises:
making a determination, by the data source management circuitry, that the data exists in an internal employee payroll data repository; and
selecting the internal employee payroll data repository as the internal source of the data.
3. The method of claim 1 , wherein identifying the internal source of the data comprises:
making a determination, by the data source management circuitry, that the data does not exist in an internal employee payroll data repository;
based on the determination, making a second determination, by the data source management circuitry, that the data exists in a direct deposit data repository; and
selecting the direct deposit data repository as the internal source of the data.
4. The method of claim 1 , wherein identifying the internal source of the data comprises:
making a determination, by the data source management circuitry, that the data does not exist in an internal employee payroll data repository;
based on the determination, making a second determination, by the data source management circuitry, that the data does not exist in a direct deposit data repository;
based on the second determination, making a third determination, by the data source management circuitry, that the data exists in a self-reported income repository; and
selecting the self-reported income repository as the internal source of the data.
5. The method of claim 1 , wherein computing the data quality score for the internal source of the data comprises:
determining, by the data source management circuitry, a quantity of computing resources that will be consumed for obtaining the data from the internal source of the data; and
assigning, by the data source management circuitry, the computational metric based on the quantity of the computing resources.
6. The method of claim 5 , wherein assigning the computational metric comprises multiplying the quantity of the computing resources by a weighting factor.
7. The method of claim 5 , wherein computing the data quality score for the internal source of the data further comprises:
determining, by the data source management circuitry, a security ranking for the internal source of the data; and
assigning, by the data source management circuitry, the security metric based on the security ranking.
8. The method of claim 7 , wherein the security ranking for the internal source of the data is higher than a security ranking of the third-party source.
9. The method of claim 1 , wherein determining where to obtain the data comprises:
making a comparison, by the data source management circuitry, of the second data quality score for obtaining the data from the third-party source to the data quality score for obtaining the data from the internal source of the data;
making a determination, by the data source management circuitry and based on the comparison, that the second data quality score is lower than the data quality score; and
selecting, by the data source management circuitry, the third-party source as the preferred source of data.
10. The method of claim 1 , wherein determining where to obtain the data comprises:
making a comparison, by the data source management circuitry, of the second data quality score for obtaining the data from the third-party source to the data quality score for obtaining the data from the internal source of the data;
making a determination, by the data source management circuitry and based on the comparison, that the second data quality score is higher than the data quality score; and
selecting, by the data source management circuitry, the internal source of the data as the preferred source of data.
11. An information manager for obtaining data, the information manager comprising:
a data source management circuitry configured to:
identify a data requirement event,
identify an internal source of data relevant to the data requirement event,
compute a data quality score for the internal source of the data, wherein the data quality score is based on at least one of a computational metric or a security metric associated with the internal source of the data,
compute a second data quality score for a third-party source, wherein the second data quality score is based on at least one of a computational metric or a security metric associated with the third-party source,
determine an entity associated with a preferred source of data based on (a) the data quality score and (b) the second data quality score, wherein the entity is the internal source of the data or the third-party source, and
obtain the data from the entity; and
a services circuitry of the information manager configured to provide computer-implemented services based on the data.
12. The information manager of claim 11 , wherein identifying the internal source of the data comprises:
making a determination, by the data source management circuitry, that the data exists in an internal employee payroll data repository; and
selecting the internal employee payroll data repository as the internal source of the data.
13. The information manager of claim 11 , wherein identifying the internal source of the data comprises:
making a determination, by the data source management circuitry, that the data does not exist in an internal employee payroll data repository;
based on the determination, making a second determination, by the data source management circuitry, that the data exists in a direct deposit data repository; and
selecting the direct deposit data repository as the internal source of the data.
14. The information manager of claim 11 , wherein identifying the internal source of the data comprises:
making a determination, by the data source management circuitry, that the data does not exist in an internal employee payroll data repository;
based on the determination, making a second determination, by the data source management circuitry, that the data does not exist in a direct deposit data repository;
based on the second determination, making a third determination, by the data source management circuitry, that the data exists in a self-reported income repository; and
selecting the self-reported income repository as the internal source of the data.
15. The information manager of claim 11 , wherein computing the data quality score for the internal source of the data comprises:
determining, by the data source management circuitry, a quantity of computing resources that will be consumed for obtaining the data from the internal source of the data; and
assigning, by the data source management circuitry, the computational metric based on the quantity of the computing resources.
16. The information manager of claim 15 , wherein assigning the computational metric comprises multiplying the quantity of the computing resources by a weighting factor.
17. The information manager of claim 15 , wherein computing the data quality score for the internal source of the data further comprises:
determining, by the data source management circuitry, a security ranking for the internal source of the data; and
assigning, by the data source management circuitry, the security metric based on the security ranking.
18. The information manager of claim 17 , wherein the security ranking of the internal source of the data is higher than a security ranking of the third-party source.
19. The information manager of claim 11 , wherein determining where to obtain the data comprises:
making a comparison, by the data source management circuitry, of the second data quality score for obtaining the data from the third-party source to the data quality score for obtaining the data from the internal source of the data;
making a determination, by the data source management circuitry and based on the comparison, that the second data quality score is lower than the data quality score; and
selecting, by the data source management circuitry, the third-party source as the preferred source of data.
20. The information manager of claim 11 , wherein determining where to obtain the data comprises:
making a comparison, by the data source management circuitry, of the second data quality score for obtaining the data from the third-party source to the data quality score for obtaining the data from the internal source of the data;
making a determination, by the data source management circuitry and based on the comparison, that the second data quality score is higher than the data quality score; and
selecting, by the data source management circuitry, the internal source of the data as the preferred source of data.