IP Library Granted Patent US 11,742,064
Granted Patent B2
US 11,742,064 · App. 16/732,210 · Granted Aug 29, 2023

Automated quality assurance testing of structured clinical data

Inventors: Jonathan Ozeran (Chicago, IL); Chris Brenner (Chicago, IL)
Assignee: TEMPUS LABS, INC.
G16H10/60G06F16/215G16H10/20G16H10/40G16H15/00G16H50/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,742,064
App. No.
16/732,210
Granted
Aug 29, 2023
Kind
B2
Abstract

A method for checking the quality of data content in a structured clinical record is disclosed. The method may include the steps of providing a data quality test that checks the content of at least a portion of the data content in the structured clinical record, applying the data quality test to the portion of the data content, and returning the results of the data quality test.

Claims (53)

1. A method for checking the quality of data content in a structured clinical record, comprising:

ingesting data from a plurality of electronically stored data sources, the data sources comprising unstructured or differently-structured data;

structuring the data from the plurality of data sources to generate a structured clinical record;

in response to a triggering event selected from among a plurality of different triggering events occurring, providing a data quality test that checks the content of at least a portion of the data content in the structured clinical record and determining whether the at least a portion of the data content is structured according to a scheme in which the at least a portion of the data content includes a data value for each data element and the data value for each data element is mapped to an accepted medical concept, the data quality test identifying which data elements within the portion of the data content to evaluate and which validation rules or checks to apply to the data elements;

applying a test suite encoded with the data quality test to the at least a portion of the data content, and determining whether the portion of the data content is structured according to the scheme, the test suite selected from among a plurality of possible test suites, wherein the test suite comprises a genetic testing test suite, and wherein the data quality test within the genetic testing test suite further includes molecular variant criteria comprising identifying a gene and a type of molecular variant of the gene;

returning the results of the data quality test; and

when the results of the data quality test indicate that the evaluated data elements are accurately structured within a threshold level, providing a copy of the portion of the data content to one or more recipients, the copy comprising the evaluated data elements,

when the results of the data quality test indicate that the evaluated data elements are not accurately structured within the threshold level,

receiving a modification associated with a structure of the portion of the data content,

restructuring the portion of the data content based on the modification such that the portion of the data content is accurately structured according to the scheme, and

providing the restructured portion of the data content to the one or more recipients.

2. The method of claim 1 , wherein the structured clinical record includes a diagnosis date and a diagnostic test date, and the data quality test checks if the diagnostic test date is prior to the diagnostic date.

3. The method of claim 1 , wherein:

the structured clinical record includes genetic testing results, and

the data quality test includes a data sufficiency criterion that checks if the genetic testing results are complete.

4. The method of claim 1 , wherein the results of the data quality test are returned in a “% success” format.

5. The method of claim 1 , further comprising:

updating the structured clinical record data in response to the results.

6. The method of claim 1 , wherein the step of applying the data quality test to the portion of the data content is performed in response to an on-demand request from a user initiating the data quality test to the portion of the data content.

7. The method of claim 1 , wherein the step of applying the data quality test to the portion of the data content is performed in response to initiating the data quality test via a background service.

8. The method of claim 7 , further comprising:

making, reviewing, and approving new code commits capturing modifications to the data quality test; and

merging the new code commits into one or more code branches for subsequent application build phases.

9. The method of claim 1 , further comprising:

receiving and processing additional structured data;

applying the data quality test to the additional structured data; and

returning the results of the data quality test applied to the additional structured data.

10. The method of claim 9 , wherein the receiving and processing steps automatically trigger the applying step.

11. The method of claim 9 , wherein the data quality test includes evaluating the additional structured data relative to other patient record data received via other sources.

12. The method of claim 11 , wherein the additional structured data is checked by the data quality test or a different data quality test.

13. The method of claim 1 , wherein the data quality test checks the content of at least a portion of the data content in the structured clinical record against clinical attributes required for inclusion in or exclusion from a clinical trial; and

determining eligibility of the patient for the clinical trial based in part on the results of the data quality test.

14. The method of claim 1 , comprising:

receiving and structuring unstructured data substantially in real time as it is being entered by a user into the clinical record,

wherein the portion of the data content comprises the resulting structured data.

15. The method of claim 14 , wherein the returning step includes informing the user of errors or incomplete information in the unstructured data.

16. The method of claim 15 , further comprising:

receiving revisions to the unstructured data substantially in real time from the user; and

repeating the structuring, initiating, and returning steps to determine whether the errors or incomplete information have been corrected.

17. The method of claim 1 , wherein the structured clinical record is stored in an electronic health record.

18. The method of claim 1 , wherein the data quality test comprises a cancer diagnosis criteria.

19. The method of claim 1 , wherein the data quality test comprises a date of cancer diagnosis criteria.

20. The method of claim 1 , wherein the data quality test comprises a metastatic cancer diagnosis criteria.

21. The method of claim 1 , wherein the data quality test comprises a date of recurrence criteria.

22. The method of claim 1 , wherein the data quality test comprises a staging criteria.

23. The method of claim 1 , wherein the data quality test comprises a medication criteria.

24. The method of claim 1 , wherein the data quality test comprises a tumor mutational burden criteria.

25. The method of claim 1 , wherein the data quality test comprises a microsatellite instability criteria.

26. The method of claim 1 , wherein the data quality test comprises a PARP inhibitor criteria.

27. The method of claim 1 , wherein the data quality test comprises a gender criteria.

28. The method of claim 1 , wherein the step of identifying a gene and a type of molecular variant comprises identifying the gene from among a plurality of possible genes.

29. The method of claim 1 , wherein the step of identifying a gene and a type of molecular variant comprises identifying the type of molecular variant from among a plurality of possible variants.

30. The method of claim 1 , wherein the step of determining whether the portion of the data content is structured into a scheme comprises determining whether the identified gene and type of molecular variant correspond to a proper combination of gene and type of molecular variant.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded May 13, 2026
From: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
To: TEMPUS AI, INC. (F/K/A TEMPUS LABS, INC.)
Reel/Frame 075608/0784 →
CHANGE OF NAME Recorded Feb 9, 2024
From: TEMPUS LABS, INC.
To: TEMPUS AI, INC.
Reel/Frame 066544/0110 →
SECURITY INTEREST Recorded Sep 22, 2022
From: TEMPUS LABS, INC.
To: ARES CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 061506/0316 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2020
From: OZERAN, JONATHAN; BRENNER, CHRIS
To: TEMPUS LABS
Reel/Frame 052593/0760 →
Continuity (2)
Provisional Application 62787249 · Dec 31, 2018
Related Publication 20200279623A1 · Sep 3, 2020
Cited By (1)
US 12,462,911