Data standardization and validation across different data systems
View Patent ↗A system standardizes and validates data across source systems and includes at least one processor. The system converts a value of a physiological attribute of an entity to a standardized value, and dynamically determines a first value range for the physiological attribute from a corresponding region of clustered physiological data of a population. The first value range is specific to and varies with an age of the entity. The standardized value of the physiological attribute is compared to the first value range, and the standardized value of the physiological attribute is designated as an outlier in response to the standardized value of the physiological attribute residing outside of the first value range. Embodiments of the present invention further include a method and computer program product for standardizing and validating data across source systems in substantially the same manner described above.
1. A computer-implemented method in a data processing system comprising at least one processor and at least one memory, the at least one memory comprising instructions executed by the at least one processor to cause the at least one processor to standardize and validate data across source systems, the computer-implemented method comprising:
converting a value of a physiological attribute of an entity to a standardized value;
dynamically determining a first value range for the physiological attribute from a corresponding region of clustered physiological data of a population, wherein the first value range is specific to and varies with an age of the entity;
comparing the standardized value of the physiological attribute to the first value range;
designating the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the first value range;
in response to the standardized value of the physiological attribute residing within the first value range:
dynamically determining a second value range for the physiological attribute from a history of physiological attribute values of the entity and corresponding ages of the entity, wherein the second value range is specific to and varies with the age of the entity;
comparing the standardized value of the physiological attribute to the second value range; and
designating the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the second value range.
2. The computer-implemented method of claim 1 , wherein the entity includes a patient, and the physiological attribute includes one or more selected from a group of height and weight.
3. The computer-implemented method of claim 1 , further comprising:
in response to the standardized value of the physiological attribute residing within the second value range:
dynamically determining a third value range for the physiological attribute based on a difference between temporally adjacent measurements of values for the physiological attribute;
comparing the standardized value of the physiological attribute to the third value range; and
designating the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the third value range.
4. The computer-implemented method of claim 1 , further comprising:
retrieving the value of the physiological attribute from one or more medical records of the entity.
5. The computer-implemented method of claim 1 , wherein the standardized value for the physiological attribute is associated with a unit of measure, and comparing the standardized value of the physiological attribute to the first value range further comprises:
changing the unit of measure to another unit of measure from among a set of units of measure in response to the standardized value with the unit of measure residing outside the first value range.
6. A system for standardizing and validating data across source systems comprising:
at least one processor configured to:
convert a value of a physiological attribute of an entity to a standardized value;
dynamically determine a first value range for the physiological attribute from a corresponding region of clustered physiological data of a population, wherein the first value range is specific to and varies with an age of the entity;
compare the standardized value of the physiological attribute to the first value range;
designate the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the first value range; and
in response to the standardized value of the physiological attribute residing within the first value range:
dynamically determine a second value range for the physiological attribute from a history of physiological attribute values of the entity and corresponding ages of the entity, wherein the second value range is specific to and varies with the age of the entity;
compare the standardized value of the physiological attribute to the second value range; and
designate the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the second value range.
7. The system of claim 6 , wherein the entity includes a patient, and the physiological attribute includes one or more selected from a group of height and weight.
8. The system of claim 6 , wherein the at least one processor is further configured to:
in response to the standardized value of the physiological attribute residing within the second value range:
dynamically determine a third value range for the physiological attribute based on a difference between temporally adjacent measurements of values for the physiological attribute;
compare the standardized value of the physiological attribute to the third value range; and
designate the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the third value range.
9. The system of claim 6 , wherein the at least one processor is further configured to:
retrieve the value of the physiological attribute from one or more medical records of the entity.
10. The system of claim 6 , wherein the standardized value for the physiological attribute is associated with a unit of measure, and comparing the standardized value of the physiological attribute to the first value range further comprises:
changing the unit of measure to another unit of measure from among a set of units of measure in response to the standardized value with the unit of measure residing outside the first value range.
11. A computer program product for standardizing and validating data across source systems, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by at least one processor to cause the at least one processor to:
convert a value of a physiological attribute of an entity to a standardized value;
dynamically determine a first value range for the physiological attribute from a corresponding region of clustered physiological data of a population, wherein the first value range is specific to and varies with an age of the entity;
compare the standardized value of the physiological attribute to the first value range;
designate the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the first value range; and
in response to the standardized value of the physiological attribute residing within the first value range:
dynamically determine a second value range for the physiological attribute from a history of physiological attribute values of the entity and corresponding ages of the entity, wherein the second value range is specific to and varies with the age of the entity;
compare the standardized value of the physiological attribute to the second value range; and
designate the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the second value range.
12. The computer program product of claim 11 , wherein the entity includes a patient, and the physiological attribute includes one or more selected from a group of height and weight.
13. The computer program product of claim 11 , wherein the at least one processor is further caused to:
in response to the standardized value of the physiological attribute residing within the second value range:
dynamically determine a third value range for the physiological attribute based on a difference between temporally adjacent measurements of values for the physiological attribute;
compare the standardized value of the physiological attribute to the third value range; and
designate the standardized value of the physiological attribute as an outlier in response to the standardized value of the physiological attribute residing outside of the third value range.
14. The computer program product of claim 11 , wherein the at least one processor is further caused to:
retrieve the value of the physiological attribute from one or more medical records of the entity.
15. The computer program product of claim 11 , wherein the standardized value for the physiological attribute is associated with a unit of measure, and comparing the standardized value of the physiological attribute to the first value range further comprises:
changing the unit of measure to another unit of measure from among a set of units of measure in response to the standardized value with the unit of measure residing outside the first value range.