IP Library Granted Patent US 10,998,104
Granted Patent B1
US 10,998,104 · App. 16/843,108 · Granted May 4, 2021

Computer network architecture with machine learning and artificial intelligence and automated insight generation

Inventors: Justin Warner (San Francisco, CA); Jean P. Drouin (San Francisco, CA); Todd Gottula (San Francisco, CA); Emmet Sun (San Francisco, CA)
Assignee: CLARIFY HEALTH SOLUTIONS, INC.
G16H50/30G06N5/041G06N20/00H04L67/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,998,104
App. No.
16/843,108
Granted
May 4, 2021
Kind
B1
Abstract

Embodiments in the present disclosure relate generally to computer network architectures for machine learning, artificial intelligence, and automated insight generation. Embodiments of computer network architecture automatically identify, measure, and generate insight reports of underperformance and over performance in healthcare practices. Embodiments may generate the insight reports of performance either occasionally on demand, or periodically, or as triggered by events such as an update of available data. Embodiments may include a combination of system databases with data provided by system users, and third-party databases to generate the insight reports, including social media data, financial data, socio-economic data, medical data, search engine data, e-commerce site data, and other databases.

Claims (164)

1. A method executed by an automated insight generation web application (AIGWA) in electronic communication, in a computer network architecture with artificial intelligence and machine learning, with a prediction module in the computer network architecture with a prediction generator and an updated database, a learning module in the computer network architecture with a training submodule, in electronic communication with the prediction module and the updated database, and a user device, the method comprising steps to:

a. log a user into the embodiment,

b. receive a request from the user that automated insight reports be generated and transmitted, for specified topics and requested subgroups of data,

c. log out the user from the AIGWA,

d. select a metric to measure the performance insight requested,

e. select benchmarking data for the selected metrics, which may be either (1) available empirical data averages from sources available to the AIGWA, or (2) the forecasted outcomes for the selected metrics from the system's patient risk scoring web application,

f. select an estimate of error for each metric,

g. search the data available to the AIGWA in the system for combinations of metrics for subgroups of data, and compute statistics summarizing each subgroup,

h. automatically generate a list of the subgroups where the selected metrics differ from the benchmarking data by a statistically significant amount of underperformance or over performance,

i. filter and rank the insights by impact on the outcomes and selected metrics, and

j. automatically generate an insight report of the underperformance and over performance, and their metrics, and transmit the report to the user, occasionally as requested, or periodically, or when triggered by an event,

wherein, the learning module is configured to:

receive a list of algorithm definitions and datasets for patient risk scoring,

automatically calibrate one or more defined algorithms with the database,

test the calibrated algorithms with a plurality of evaluation metrics,

store the calibrated algorithms and evaluation metrics in a library,

automatically select an algorithm for patient risk scoring based on the evaluation metrics,

update further the database with third party data, and with user episode data, and

re-execute the calibrate, test, store, and select steps after the update of the database step,

wherein, the prediction generator is configured to:

receive a user prediction request for patient risk scoring, including episode data and a client model,

run the currently selected algorithm corresponding to the user of the episode data, and generate patient risk scoring prediction output,

generate a patient risk scoring prediction report based on the algorithm output, and

transmit the patient risk scoring prediction report to the user,

wherein, the algorithm definitions are of types that are members of the group comprising:

multi-level models,

random forest regression,

logistical regression,

gamma-distributed regression, and

linear regression;

wherein the third party data is from a party that is a member of the group comprising:

hospitals,

medical practices,

insurance companies,

credit reporting agencies, and

credit rating agencies;

wherein the database includes patient medical data, patient personal data, patient outcome data, and medical treatment data;

wherein the episode data includes individual patient medical data and personal data; and

wherein the user is a member of the group comprising:

hospitals,

medical practices, and

insurance companies,

wherein the user device is remote from the prediction module, and

the user device is a member of the group comprising:

a computer,

a desktop PC,

a laptop PC,

a smart phone,

a tablet computer, and

a personal wearable computing device,

wherein the web application communicates with the user device by the Internet, or an extranet, or a VPN, or other network, and the web application is generic for any user, or customized for a specific user, or class of user,

wherein, the user prediction request requests calibration of the correlation of demographic, social and medical attributes of the patient, to the outcome of a specific patient clinical episode type, and

wherein the updated database includes data from at least one third party, containing data of one or more types from the group consisting of: medical claims data, prescription refill data, publicly available social media data, socio-economic data, credit agency data, marketing data, travel website data, e-commerce website data, search engine data, credit card data, credit score and credit history data, lending data, mortgage data, financial data, travel data, geolocation data, telecommunications usage data, and other third-party databases.

2. A method executed by an automated insight generation web application (AIGWA) in electronic communication, in a computer network architecture with artificial intelligence and machine learning, with a prediction module in the computer network architecture with a prediction generator and an updated database, a learning module in the computer network architecture with a training submodule, in electronic communication with the prediction module and the updated database, and a user device, the method comprising steps to:

a. log a user into an Automated Insight Generation Web Application (AIGWA) embodiment,

b. receive a request from the user that automated insight reports be generated and transmitted, for specified topics and requested subgroups of data,

c. log the user out from the AIGWA,

d. select a metric to measure the performance insight requested,

e. select benchmarking data for the selected metrics, which may be either (1) available empirical data averages from sources available to the AIGWA, or (2) the forecasted outcomes for the selected metrics from the system's patient risk scoring web application,

f. select an estimate of error for each metric,

g. search the data available to the AIGWA in the system for combinations of metrics for subgroups of data, and compute statistics summarizing each subgroup,

h. automatically generate a list of the subgroups where the selected metrics differ from the benchmarking data by a statistically significant amount of underperformance or over performance,

i. filter and rank the insights by impact on the outcomes and selected metrics, and

j. automatically generate an insight report of the underperformance and over performance, and their metrics, and transmit the report to the user, occasionally as requested, or periodically, or when triggered by an event.

3. The method of claim 2 : wherein, the learning module is configured to:

receive a list of algorithm definitions and datasets for patient risk scoring,

automatically calibrate one or more defined algorithms with the database,

test the calibrated algorithms with a plurality of evaluation metrics,

store the calibrated algorithms and evaluation metrics in a library,

automatically select an algorithm for patient risk scoring based on the evaluation metrics,

update further the database with third party data, and with user episode data, and

re-execute the calibrate, test, store, and select steps after the update of the database step.

4. The method of claim 2 ,

wherein:

the prediction generator is configured to:

receive a user prediction request for patient risk scoring, including episode data and a client model,

run the currently selected algorithm corresponding to the user of the episode data, and generate patient risk scoring prediction output,

generate a patient risk scoring prediction report based on the algorithm output, and

transmit the patient risk scoring prediction report to the user.

5. The method of claim 2 ,

wherein:

the algorithm definitions are of types that are members of the group comprising:

multi-level models,

random forest regression,

logistical regression,

gamma-distributed regression, and

linear regression;

the third party data is from a party that is a member of the group comprising:

hospitals,

medical practices,

insurance companies,

credit reporting agencies, and

credit rating agencies;

the database includes patient medical data, patient personal data, patient outcome data, and medical treatment data;

the episode data includes individual patient medical data and personal data; and

the user is a member of the group comprising:

hospitals,

medical practices, and

insurance companies.

6. The method of claim 2 ,

wherein the user device is remote from the prediction module, and

the user device is a member of the group comprising:

a computer,

a desktop PC,

a laptop PC,

a smart phone,

a tablet computer, and

a personal wearable computing device.

7. The method of claim 2 , wherein the web application communicates with the user device by the Internet, or an extranet, or a VPN, or other network, and the web application is generic for any user, or customized for a specific user, or class of user, and

wherein, the user prediction request requests calibration of the correlation of demographic, social and medical attributes of the patient, to the outcome of a specific patient clinical episode type.

8. The method of claim 2 , wherein the updated database includes data from at least one third party, containing data of one or more types from the group consisting of: medical claims data, prescription refill data, publicly available social media data, socio-economic data, credit agency data, marketing data, travel web site data, e-commerce web site data, search engine data, credit card data, credit score and credit history data, lending data, mortgage data, financial data, travel data, geolocation data, telecommunications usage data, and other third-party databases.

9. A method executed by a web application for artificial intelligence and machine learning and automated insight generation within a computer network architecture including an automated insight generation web application (AIGWA) in electronic communication with a prediction module, a patient risk scoring web application, and a user device, the method comprising steps to:

a. log a user into an Automated Insight Generation Web Application (AIGWA) embodiment,

b. receive a request from the user that automated insight reports be generated and transmitted, for specified topics and requested subgroups of data,

c. log the user out from the AIGWA,

d. select a metric to measure the performance insight requested,

e. select benchmarking data for the selected metrics, which may be either (1) available empirical data averages from sources available to the AIGWA, or (2) the forecasted outcomes for the selected metrics from the system's patient risk scoring web application,

f. select an estimate of error for each metric,

g. search the data available to the AIGWA in the system for combinations of metrics for subgroups of data, and compute statistics summarizing each subgroup,

h. automatically generate a list of the subgroups where the selected metrics differ from the benchmarking data by a statistically significant amount of underperformance or over performance,

i. filter and ranks the insights by impact on the outcomes and selected metrics, and

j. automatically generate an insight report of the underperformance and over performance, and their metrics, and transmit the report to the user, occasionally as requested, or periodically, or when triggered by an event,

wherein, the learning module is configured to:

receive a list of algorithm definitions and datasets for patient risk scoring,

automatically calibrate one or more defined algorithms with the database,

test the calibrated algorithms with a plurality of evaluation metrics,

store the calibrated algorithms and evaluation metrics in a library,

automatically select an algorithm for patient risk scoring based on the evaluation metrics,

update further the database with third party data, and with user episode data, and

re-execute the calibrate, test, store, and select steps after the update of the database step,

wherein, the prediction generator is configured to:

receive a user prediction request for patient risk scoring, including episode data and a client model,

run the currently selected algorithm corresponding to the user of the episode data, and generate patient risk scoring prediction output,

generate a patient risk scoring prediction report based on the algorithm output, and

transmit the patient risk scoring prediction report to the user,

wherein, the algorithm definitions are of types that are members of the group comprising:

multi-level models,

random forest regression,

logistical regression,

gamma-distributed regression, and

linear regression;

wherein the third party data is from a party that is a member of the group comprising:

hospitals,

medical practices,

insurance companies,

credit reporting agencies, and

credit rating agencies;

wherein the database includes patient medical data, patient personal data, patient outcome data, and medical treatment data;

wherein the episode data includes individual patient medical data and personal data; and

wherein the user is a member of the group comprising:

hospitals,

medical practices, and

insurance companies,

wherein, the user device is remote from the prediction module, and

the user device is a member of the group comprising:

a computer,

a desktop PC,

a laptop PC,

a smart phone,

a tablet computer, and

a personal wearable computing device,

wherein the web application communicates with the user device by the Internet, or an extranet, or a VPN, or other network, and the web application is generic for any user, or customized for a specific user, or class of user, and

wherein, the user prediction request requests calibration of the correlation of demographic, social and medical attributes of the patient, to the outcome of a specific patient clinical episode type.

10. The method of claim 9 , wherein the updated database includes data from at least one third party, containing data of one or more types from the group consisting of: medical claims data, prescription refill data, publicly available social media data, socio-economic data, credit agency data, marketing data, travel web site data, e-commerce web site data, search engine data, credit card data, credit score and credit history data, lending data, mortgage data, financial data, travel data, geolocation data, telecommunications usage data, and other third-party databases.

Assignments (2)
SECURITY INTEREST Recorded Jun 1, 2026
From: CLARIFY HEALTH SOLUTIONS, INC.; LOYAL HEALTH HOLDINGS, INC.; LOYAL HEALTH, LLC
To: SYMBIOTIC CAPITAL AGENCY LLC, AS COLLATERAL AGENT
Reel/Frame 074811/0625 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2020
From: WARNER, JUSTIN; DROUIN, JEAN P., M.D.; GOTTULA, TODD; SUN, EMMET
To: CLARIFY HEALTH SOLUTIONS, INC.
Reel/Frame 052429/0883 →
Continuity (1)
Continuation 16587780 · Sep 30, 2019
Cited By (1)
US 12,271,387