Data quality monitors
View Patent ↗Systems and methods are presented for data quality monitoring. Data quality monitors may be created and configured to identify objects with specified data quality issues and/or property values. Objects identified by a data quality monitor can be presented to users for confirmation and resolution. Properties used by the data quality monitor to match objects may also be displayed to users.
1. A computer system comprising:
one or more computer processors; and
a tangible storage device storing instructions configured for execution by the one or more computer processors in order to cause the computer system to:
receive, from a user of the computer system, a selection of a first object type, wherein a first object corresponds to the first object type;
receive, from the user of the computer system, a selection of one or more of a plurality of second object types that the first object type is required to be associated with, wherein a second object corresponds to one or more of the plurality of second object types, and wherein the first object is associated with the second object;
identify respective objects of the first object type that are each associated with one or more of the plurality of second object types, the identified objects comprising the first object, wherein each of the identified objects have one or more properties;
receive, from the user of the computer system, a selection of one or more data quality criterion to be identified in the identified objects;
determine potential data quality problems of the identified objects by matching the one or more data quality criterion with the respective one or more properties of the identified objects;
generate a user interface indicating the potential data quality problems of the identified objects; and
display, for user selection in the user interface, a potential resolution for the potential data quality problem.
2. The computer system of claim 1 , wherein the one or more data quality criterion are configured to identify the potential data quality problems including at least one of: possible duplicate objects, missing properties, multi-valued properties, unparsed properties, disallowed enumerations, numeric range violations, and date range violations.
3. The computer system of claim 2 , wherein the potential data quality problem is missing properties; and
said one or more data quality criterion identify objects that are missing at least a property value that is predetermined to be necessary.
4. The computer system of claim 2 , wherein the potential data quality problem is a multi-valued properties, and
said one or more data quality criterion identify objects having multiple property values for individual properties that are each predetermined to have only one property value.
5. The computer system of claim 1 , wherein one or more of the plurality of second object types comprise object types with one or more properties and/or property values used for identifying fraudulent transactions and/or object types used for crime investigations.
6. The computer system of claim 2 , wherein the potential data quality problem is unparsed properties, and
said one or more data quality criterion identify objects that have one or more property values including unparsed data.
7. The computer system of claim 6 , wherein the unparsed data takes on a meaning unintended by a data source providing the unparsed data.
8. The computer system of claim 2 , wherein the potential data quality problem is possible duplicate objects, and
said one or more data quality criterion identify two or more objects each having common property values for a predetermined quantity of properties.
9. The computer system of claim 2 , wherein the potential data quality problem is disallowed enumerations, and
said one or more data quality criterion identify objects that have one or more property values including disallowed enumerations.
10. The computer system of claim 2 , wherein the potential data quality problem is numeric range violation, and
said one or more data quality criterion identify respective objects that have one or more property values that violate an allowed numeric range for the respective property.
11. The computer system of claim 2 , wherein the potential data quality problem is date range violation, and
said one or more data quality criterion identify objects that have one or more property values that violate an allowed date range for the respective properties.
12. A non-transitory computer-readable storage medium comprising computer-executable instructions that direct a computing system to:
receive, from a user of the computing system, a selection of a first object type, wherein a first object corresponds to the first object type;
receive, from the user of the computing system, a selection of one or more of a plurality of second object types that the first object type is required to be associated with, wherein a second object corresponds to one or more of the plurality of second object types, and wherein the first object is associated with the second object;
identify respective objects of the first object type that are each associated with one or more of the plurality of second object types, the identified objects comprising the first object, wherein each of the identified objects have one or more properties;
receive, from the user of the computing system, a selection of one or more data quality criterion to be identified in the identified objects;
determine potential data quality problems of the identified objects by matching the one or more data quality criterion with the respective one or more properties of the identified objects;
generate a user interface indicating the potential data quality problems of the identified objects; and
display, for user selection in the user interface, a potential resolution for the potential data quality problem.
13. The non-transitory computer-readable storage medium of claim 12 , wherein the one or more data quality criterion are configured to identify the potential data quality problems including at least one of: possible duplicate objects, missing properties, multi-valued properties, unparsed properties, disallowed enumerations, numeric range violations, and date range violations.
14. The non-transitory computer-readable storage medium of claim 13 , wherein the potential data quality problem is missing properties; and
said one or more data quality criterion identify objects that are missing at least a property value that is predetermined to be necessary.
15. The non-transitory computer-readable storage medium of claim 13 , wherein the potential data quality problem is a multi-valued properties, and
said one or more data quality criterion identify objects having multiple property values for individual properties that are each predetermined to have only one property value.
16. The non-transitory computer-readable storage medium of claim 13 , wherein the potential data quality problem is unparsed properties, and
said one or more data quality criterion identify objects that have one or more property values including unparsed data.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the unparsed data takes on a meaning unintended by a data source providing the unparsed data.
18. The non-transitory computer-readable storage medium of claim 13 , wherein the potential data quality problem is possible duplicate objects, and
said one or more data quality criterion identify two or more objects each having common property values for a predetermined quantity of properties.
19. The non-transitory computer-readable storage medium of claim 13 , wherein the potential data quality problem is disallowed enumerations, and
said one or more data quality criterion identify objects that have one or more property values including disallowed enumerations.
20. The non-transitory computer-readable storage medium of claim 13 , wherein the potential data quality problem is numeric range violation, and
said one or more data quality criterion identify respective objects that have one or more property values that violate an allowed numeric range for the respective property.