Systems and methods for validating and updating medical record data
A system for validating and updating records, such as medical records, is provided. The system includes a flexible operation and transaction based framework that allows for the handling of a variety of record validation and updating scenarios. The system provides many advanced features related to confidentiality, performance, and auditing. The system may perform one or more operations on the medical records in an order defined by a transaction file in order to achieve a goal such as medical record deduplication. Each operation may take an input one or more input files, output files of previous operations, or one or more medical records. Each operation may generate one or more output files including input data for a subsequent operation, and success or failure files that describe the actions performed by the operation. The success or failure files may also be used by subsequent operations.
1. A system comprising:
one or more processors; and
one or more memories storing processor-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
selecting a transaction file comprising a plurality of ordered operations for removing duplicate records from a plurality of records, the plurality of ordered operations including a query operation and a filter operation;
executing the query operation, at least in part by:
for each patient item of a plurality of patient items, performing a respective one or more patient record queries to attempt to populate a respective patient data structure of a plurality of patient data structures; and
generating a plurality of output files of the query operation, wherein the plurality of output files of the query operation includes a success file that includes information about ones of the plurality of patient data structures that are fully populated and a failure file that includes information about ones of the plurality of patient data structures that are not fully populated; and
executing the filter operation using the plurality of output files of the query operation as input data for the filter operation, wherein executing the filter operation includes performing inclusion and exclusion operations based at least in part on the success file and the failure file.
2. The system of claim 1 , wherein the plurality of output files includes JSON files.
3. The system of claim 1 , wherein the plurality of ordered operations further includes one or more of: (i) one or more transform operations, (ii) one or more update operations, (iii) one or more statistic operations, (iv) one or more sequence fix operations, (v) one or more sequence check operations, or (vi) one or more audit operations.
4. The system of claim 1 , wherein the plurality of ordered operations further includes one or more of:
one or more duplicate patient record update operations;
one or more duplicate patient updated record query operations;
one or more patient updated record rollback operations; or
one or more duplicate patient audit operations.
5. The system of claim 1 , wherein the plurality of ordered operations are arranged according to a branching order.
6. The system of claim 1 , wherein at least one operation of the plurality of ordered operations sets one or more of an obfuscation flag, an encryption flag, or a redaction flag.
7. A method for updating and validating medical records comprising:
selecting, by one or more processors, a transaction file comprising a plurality of ordered operations for removing duplicate records from a plurality of records, the plurality of ordered operations including a query operation and a filter operation;
executing, by the one or more processors, the query operation, wherein executing the query operation comprises:
for each patient item of a plurality of patient items, performing a respective one or more patient record queries to attempt to populate a respective patient data structure of a plurality of patient data structures; and
generating a plurality of output files of the query operation, wherein the plurality of output files of the query operation includes a success file that includes information about ones of the plurality of patient data structures that are fully populated and a failure file that includes information about ones of the plurality of patient data structures that are not fully populated; and
executing, by the one or more processors, the filter operation using the plurality of output files of the query operation as input data for the filter operation, wherein executing the filter operation includes performing inclusion and exclusion operations based at least in part on the success file and the failure file.
8. The method of claim 7 , wherein the plurality of output files includes JSON files.
9. The method of claim 8 , wherein the plurality of ordered operations further includes transform operations, update operations, statistic operations, sequence fix operations, sequence check operations, and audit operations.
10. The method of claim 8 , wherein the plurality of ordered operations further includes one or more of:
one or more duplicate patient record update operations;
one or more duplicate patient updated record query operations;
one or more patient updated record rollback operations; or
one or more duplicate patient audit operations.
11. The method of claim 7 , wherein the plurality of ordered operations are arranged according to a branching order.
12. The method of claim 7 , wherein at least one operation of the plurality of ordered operations sets one or more of an obfuscation flag, an encryption flag, or a redaction flag.
13. One or more non-transitory computer-readable media storing processor-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
selecting a transaction file comprising a plurality of ordered operations for removing duplicate records from a plurality of records, the plurality of ordered operations including a query operation and a filter operation;
executing the query operation, wherein executing the query operation comprises:
for each patient item of a plurality of patient items, performing a respective one or more patient record queries to attempt to populate a respective patient data structure of a plurality of patient data structures; and
generating a plurality of output files of the query operation, wherein the plurality of output files of the query operation includes a success file that includes information about ones of the plurality of patient data structures that are fully populated and a failure file that includes information about ones of the plurality of patient data structures that are not fully populated; and
executing the filter operation using the plurality of output files of the query operation as input data for the filter operation, wherein executing the filter operation includes performing inclusion and exclusion operations based at least in part on the success file and the failure file.
14. The one or more non-transitory computer-readable media of claim 13 , wherein the plurality of output files includes JSON files.