Health care information system and method for transforming health care data with a transformation pipeline
View Patent ↗A health care information system, method and computer program product are provided to transform health care data in an efficient manner. In the context of a health care information system, the health care information system includes processing circuitry configured to define a transformation pipeline that includes a plurality of ordered transform elements. The processing circuitry is also configured to ingest health care data with the transformation pipeline in order to transform the health care data. The processing circuitry is further configured to track propagation of data representative of or associated with the health care data through the transformation pipeline. The processing circuitry is configured to track the propagation by identifying one or more completed transform elements that have completed processing of the data and by also identifying one or more ongoing transform elements that have begun processing of the data but for which the processing is incomplete.
1. A health care information system configured to transform health care data, the health care information system comprising processing circuitry configured to:
define a transformation pipeline comprising a plurality of ordered transform elements;
ingest health care data with the transformation pipeline in order to transform the health care data;
track propagation of processed data representative of or associated with the health care data through the transformation pipeline, wherein the processing circuitry is configured to track the propagation by identifying the one or more completed transform elements that have completed processing of the processed data and also identifying the one or more ongoing transform elements that have begun processing of the processed data but for which the processing is incomplete; and
upon transformation failure that occurs: (1) after having completed processing of the processed data by one or more completed transform elements and also (2) after having commenced, but prior to having completed, processing of the processed data by one or more ongoing transform elements, recommence transformation of the health care data with the one or more ongoing transform elements that had begun, but not yet completed processing when the transformation failure occurred without repeating the processing provided by the one or more completed transform elements,
wherein the transformation of the health care data is recommenced after transformation failure with the one or more ongoing transform elements such that the health care data is completely transformed by being fully processed by all of the ordered transform elements.
2. A health care information system according to claim 1 wherein the processing circuitry is further configured to:
receive notification of a transformation failure; and
determine the one or more ongoing transform elements when the transformation failure occurred.
3. A health care information system according to claim 1 wherein the processing circuitry is configured to define the transformation pipeline by determining the plurality of ordered transform elements to be applied to the health care data based at least partially upon a source of the health care data.
4. A health care information system according to claim 1 wherein the transformation pipeline produces transformed data, wherein the processing circuitry is further configured to associate metadata with the transformed data, and wherein the metadata includes a transformation graph that provides an identification of each of the transform elements of the transformation pipeline that produced the transformed data associated with the metadata.
5. A health care information system according to claim 4 wherein the metadata includes an identification of a version of each of the transform elements of the transformation pipeline.
6. A health care information system according to claim 4 wherein the metadata includes an identification of a version of the health care data ingested with the transformation pipeline to produce the transformed data associated with the metadata.
7. A health care information system according to claim 1 wherein the transform elements comprise one or more system-specific transform elements configured to transform health care data that has a respective data format to a neutral health care data format, and wherein the transform elements comprise one or more system-neutral transform elements configured to transform health care data that has the neutral health care data format.
8. A method for transforming health care data, the method comprising:
defining a transformation pipeline comprising a plurality of ordered transform elements;
ingesting health care data with the transformation pipeline in order to transform the health care data;
tracking propagation of processed data representative of or associated with the health care data through the transformation pipeline, wherein tracking the propagation comprises identifying the one or more completed transform elements that have completed processing of the processed data and also identifying the one or more ongoing transform elements that have begun processing of the processed data but for which the processing is incomplete; and
upon transformation failure that occurs: (1) after having completed processing of the processed data by one or more completed transform elements and also (2) after having commenced, but prior to having completed, processing of the processed data by one or more ongoing transform elements, recommencing transformation of the health care data with the one or more ongoing transform elements that had begun, but not yet completed processing when the transformation failure occurred without repeating the processing provided by the one or more completed transform elements,
wherein the transformation of the health care data is recommenced after transformation failure with the one or more ongoing transform elements such that the health care data is completely transformed by being fully processed by all of the ordered transform elements.
9. A method according to claim 8 further comprising:
receiving notification of a transformation failure; and
determining the one or more ongoing transform elements when the transformation failure occurred.
10. A method according to claim 8 wherein defining the transformation pipeline comprises determining the plurality of ordered transform elements to be applied to the health care data based at least partially upon a source of the health care data.
11. A method according to claim 8 wherein the transformation pipeline produces transformed data, wherein the method further comprises associating metadata with the transformed data, and wherein the metadata includes a transformation graph that provides an identification of each of the transform elements of the transformation pipeline that produced the transformed data associated with the metadata.
12. A method according to claim 11 wherein the metadata includes an identification of a version of each of the transform elements of the transformation pipeline.
13. A method according to claim 11 wherein the metadata includes an identification of a version of the health care data ingested with the transformation pipeline to produce the transformed data associated with the metadata.
14. A method according to claim 8 wherein the transform elements comprise one or more system-specific transform elements configured to transform health care data that has a respective data format to a neutral health care data format, and wherein the transform elements comprise one or more system-neutral transform elements configured to transform health care data that has the neutral health care data format.
15. A computer program product for transforming health care data, the computer program product comprising at least one non-transitory computer-readable storage medium having computer-executable program code portions stored therein, the computer-executable program code portions comprising program code instructions for:
defining a transformation pipeline comprising a plurality of ordered transform elements;
ingesting health care data with the transformation pipeline in order to transform the health care data;
tracking propagation of processed data representative of or associated with the health care data through the transformation pipeline, wherein the program code instructions for tracking the propagation comprise program code instructions for identifying the one or more completed transform elements that have completed processing of the processed data and program code instructions for identifying the one or more ongoing transform elements that have begun processing of the processed data but for which the processing is incomplete; and
upon transformation failure that occurs: (1) after having completed processing of the processed data by one or more completed transform elements and also (2) after having commenced, but prior to having completed, processing of the processed data by one or more ongoing transform elements, recommencing transformation of the health care data with the one or more ongoing transform elements that had begun, but not yet completed processing when the transformation failure occurred without repeating the processing provided by the one or more completed transform elements,
wherein the transformation of the health care data is recommenced after transformation failure with the one or more ongoing transform elements such that the health care data is completely transformed by being fully processed by all of the ordered transform elements.
16. A computer program product according to claim 15 wherein the computer-executable program code portions further comprise program code instructions for:
receiving notification of a transformation failure; and
determining the one or more ongoing transform elements when the transformation failure occurred.
17. A computer program product according to claim 15 wherein the transformation pipeline produces transformed data, wherein the computer-executable program code portions further comprise program code instructions for associating metadata with the transformed data, and wherein the metadata includes a transformation graph that provides an identification of each of the transform elements of the transformation pipeline that produced the transformed data associated with the metadata.
18. A computer program product according to claim 17 wherein the metadata includes an identification of a version of each of the transform elements of the transformation pipeline.
19. A computer program product according to claim 17 wherein the metadata includes an identification of a version of the health care data ingested with the transformation pipeline to produce the transformed data associated with the metadata.
20. A computer program product according to claim 15 wherein the transform elements comprise one or more system-specific transform elements configured to transform health care data that has a respective data format to a neutral health care data format, and wherein the transform elements comprise one or more system-neutral transform elements configured to transform health care data that has the neutral health care data format.