IP Library Granted Patent US 10,854,319
Granted Patent B2
US 10,854,319 · App. 16/680,898 · Granted Dec 1, 2020

Systems and methods for visualizing clinical trial site performance

Inventors: Nathaniel P. Katz (Natick, MA); Arturo J. Morales (Stow, MA)
Assignee: Analgesic Solutions LLC
G16H10/20G06T11/001G06T11/60A61B5/4848A61B5/742G16H40/67
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,854,319
App. No.
16/680,898
Granted
Dec 1, 2020
Kind
B2
Abstract

Systems and methods for visualizing clinical trial site performance, or other multi-dimensional (or multi-parameter) datasets.

Claims (36)

1. A clinical monitoring system comprising:

one or more memory units each operable to store at least one program; and

at least one processor communicatively coupled to the one or more memory units, in which the at least one program, when executed by the at least one processor, causes the at least one processor to perform the operations of:

monitoring clinical data, the clinical data representative of one or more characteristics of a respective clinical trial site, multiple clinical trial sites, a geographic region, and one or more clinical subjects;

generating one or more clinical data points for a control chart based on the clinical data;

applying a respective statistical process control (SPC) function to each of the clinical data to identify and distinguish non-random patterns from random patterns in the clinical data and generate a plurality of respective clinical data signals, wherein one of the respective clinical data signals is indicative of e-diary non-compliance, wherein one of the respective clinical data signals is indicative of study drug compliance, and wherein one of the respective clinical data signals is indicative of discordance between symptom scores;

applying, using a rules engine, one or more rules to each of the clinical data signal, and determining whether one or more of the clinical data signal meets clinical trial threshold alert criteria;

in response to determining that a respective clinical data signal meets clinical trial threshold alert criteria, wherein the clinical trial threshold alert criteria includes a criterion that is met when the SPC function identifies a non-random pattern in the clinical data:

updating a user interface at a client device to identify a corresponding one or more clinical trial sites and/or clinical subjects and to cause an intervention at the corresponding clinical trial sites and/or clinical subjects, wherein the user interface includes an e-diary non-compliance control chart indicative of e-diary non-compliance, wherein one or more clinical data points of the e-diary non-compliance control chart are updated based on the one of the respective SPC function clinical data signals indicative of e-diary non-compliance, wherein the user interface includes a study drug compliance control chart indicative of study drug compliance, wherein one or more clinical data points of the study drug compliance control chart are updated based on the one of the respective SPC function clinical data signals indicative of study drug compliance, wherein the user interface includes a discordance between symptom scores control chart indicative of discordance between symptom scores, wherein one or more clinical data points of the discordance between symptom scores control chart are updated based on the one of the respective SPC function clinical data signals indicative of discordance between symptom scores; and

in response to determining that the respective clinical data signal does not meet clinical trial threshold alert criteria:

updating a user interface at a corresponding client device to visualize one or more representations of the clinical data signals.

2. The system of claim 1 , wherein clinical trial threshold alert criteria is met when the one or more of the respective clinical data signal exceeds a respective clinical trial threshold.

3. The system of claim 2 , wherein the processor is further configured to perform the operation of: adjusting the clinical trial threshold to minimize the number of false positive and false negatives.

4. The system of claim 1 , wherein the processor is further configured to perform the operation of:

selecting one or more clinical data, from a set of clinical data signals based on whether the selected clinical data signal is a respective clinical data signal.

5. The system of claim 1 , wherein the processor is further configured to: forego selecting clinical data, from a set of clinical data signals based on whether the selected clinical data signal is a static clinical data.

6. The system of claim 1 , wherein statistical process control functions include at least one of: a regression analysis to assess a treatment difference between a placebo and an active drug involved in the clinical trial.

7. The system of claim 1 , wherein further intervention includes at least one of: root cause analysis, subject retraining, subject exclusion, site retraining, and/or site exclusion.

8. The system of claim 1 , wherein the clinical data is time-varying.

9. A clinical monitoring method comprising:

monitoring clinical data, the clinical data representative of one or more characteristics of a respective clinical trial site, multiple clinical trial sites, a geographic region, and one or more clinical subjects;

generating one or more clinical data points for a control chart based on the clinical data;

applying a respective statistical process control (SPC) function to each of the clinical data to identify and distinguish non-random patterns from random patterns in the clinical data and generate a plurality of respective clinical data signals, wherein one of the respective clinical data signals is indicative of e-diary non-compliance, wherein one of the respective clinical data signals is indicative of study drug compliance, and wherein one of the respective clinical data signals is indicative of discordance between symptom scores;

applying, using a rules engine, one or more rules to each of the clinical data signal, and determining whether one or more of the clinical data signal meets clinical trial threshold alert criteria;

in response to determining that a respective clinical data signal meets clinical trial threshold alert criteria, wherein the clinical trial threshold alert criteria includes a criterion that is met when the SPC function identifies a non-random pattern in the clinical data:

updating a user interface at a client device to identify a corresponding one or more clinical trial sites and/or clinical subjects and to cause an intervention at the corresponding clinical trial sites and/or clinical subjects, wherein the user interface includes an e-diary non-compliance control chart indicative of e-diary non-compliance, wherein one or more clinical data points of the e-diary non-compliance control chart are updated based on the one of the respective SPC function clinical data signals indicative of e-diary non-compliance, wherein the user interface includes a study drug compliance control chart indicative of study drug compliance, wherein one or more clinical data points of the study drug compliance control chart are updated based on the one of the respective SPC function clinical data signals indicative of study drug non-compliance, wherein the user interface includes a discordance between symptom scores control chart indicative of discordance between symptom scores, wherein one or more clinical data points of the discordance between symptom scores control chart are updated based on the one of the respective SPC function clinical data signals indicative of discordance between symptom scores; and

in response to determining that the respective clinical data signal does not meet clinical trial threshold alert criteria:

updating a user interface at a corresponding client device to visualize one or more representations of the clinical data signals.

10. The method of claim 9 , wherein clinical trial threshold alert criteria is met when the one or more of the respective clinical data signal exceeds a respective clinical trial threshold.

11. The method of claim 10 , further comprising: adjusting the clinical trial threshold to minimize the number of false positive and false negatives.

12. The method of claim 9 , further comprising:

selecting one or more clinical data, less than all, from a set of clinical data signals based on whether the selected clinical data signal is a respective clinical data signal.

13. The method of claim 9 , further comprising: forego selecting clinical data, from a set of clinical data signals based on whether the selected clinical data signal is a static clinical data.

14. The method of claim 9 , wherein statistical process control functions include at least one of: a regression analysis to assess a treatment difference between a placebo and an active drug involved in the clinical trial.

15. The method of claim 9 , wherein intervening at the corresponding clinical trial sites and/or clinical subjects includes a root cause analysis, subject retraining, subject exclusion, site retraining, and/or site exclusion.

16. The method of claim 9 , wherein the clinical data is time-varying.

Assignments (7)
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY RECORDED AT REEL 071829 AND FRAME 0743 Recorded Mar 24, 2026
From: ALTER DOMUS (US) LLC
To: MEDAVANTE-PROPHASE, LLC; ANALGESIC SOLUTIONS LLC
Reel/Frame 075224/0015 →
SECURITY AGREEMENT (JOINDER) Recorded Jul 7, 2025
From: MEDAVANTE-PROPHASE, LLC; ANALGESIC SOLUTIONS LLC
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 071829/0743 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded May 2, 2025
From: BARCLAYS BANK PLC, AS COLLATERAL AGENT
To: MEDAVANTE-PROPHASE, LLC; ANALGESIC SOLUTIONS LLC
Reel/Frame 071161/0701 →
RELEASE OF SECURITY INTEREST Recorded May 2, 2025
From: WILMINGTON TRUST, NATIONAL ASSOCIATION
To: THREEWIRE, INC.; MEDAVANTE-PROPHASE, INC.; ANALGESIC SOLUTIONS LLC
Reel/Frame 071007/0474 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2020
From: KATZ, NATHANIEL P.; MORALES, ARTURO J.
To: ANALGESIC SOLUTIONS LLC
Reel/Frame 054138/0627 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jan 8, 2020
From: ANALGESIC SOLUTIONS LLC; MEDAVANTE-PROPHASE, INC.; THREEWIRE, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 051504/0849 →
SECURITY INTEREST Recorded Jan 8, 2020
From: THREEWIRE, INC.; MEDAVANTE-PROPHASE, INC.; ANALGESIC SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 051454/0322 →
Continuity (3)
Continuation PCTUS2018031829 · May 9, 2018
Provisional Application 62503537 · May 9, 2017
Related Publication 20200082920A1 · Mar 12, 2020