IP Library › Granted Patent US 12,412,662
Granted Patent B2
US 12,412,662 · App. 18/367,849 · Granted Sep 9, 2025

Supervised machine learning-based modeling of sensitivities to potential disruptions

Inventors: Gerald Fahner (Austin, TX); Brad Vancho (San Francisco, CA)
Assignee: FAIR ISAAC CORPORATION
G16H50/20G06N20/20G06Q10/0635G06Q10/06375G06Q40/03G16H50/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,412,662
App. No.
18/367,849
Granted
Sep 9, 2025
Kind
B2
Abstract

Computer-implemented systems, methods and products for modeling sensitivities to potential disruptions by observing performances of entities in a first sub-population and a second sub-population using a machine learning model comprising a set of predictors and a binary indicator variable associated with a first entity subjected to a first event associated with the first sub-population, the machine learning model trained to predict an expected performance for the first entity based on at least one of a known attribute associated with the first entity in relation to the first event and a value of the binary indicator variable associated with the first event.

Claims (41)

1. An improved computer-implemented treatment system comprising:

one or more processors coupled to one or more data storage devices to process or store data associated with known attributes for a plurality of entities subjected to a plurality of known events;

a machine learning model implemented as a data structure stored in the one or more data storage devices, the machine learning model trained to observe performances of the plurality of entities in a first sub-population and a second sub-population,

the machine learning model associated with a set of predictors and at least a binary indicator variable corresponding to a first entity subjected to a first event experienced by members of the first sub-population,

the machine learning model trained to predict an expected performance for the first entity based on at least one of (1) a known attribute associated with the first entity in relation to the first event and (2) a value of the binary indicator variable associated with the first event,

members of the first sub-population and the second sub-population being distinguishable based on whether one or more events have been experienced by the members of the first sub-population and the second sub-population, the members of the first sub-population experiencing the first event and the members of the second sub-population experiencing a second event,

wherein an expected performance of the first entity subjected to the first event is determined based on a sensitivity value determined for the first entity by quantifying an expected performance of a member of the first sub-population subjected to the first event according to a sensitivity index generated based on different permutations of potential outcomes for the plurality of known events according to a weighted combination of outputs of multiple sensitivity index models focused on types of disruption or predicted outcomes, the sensitivity index models being generated based on disruption type or target outcome, and

a treatment being administered to the first entity, responsive to the determined expected performance, wherein the sensitivity index predicts how sensitive a predicted outcome for the first entity is.

2. The system of claim 1 , wherein the first sub-population and the second sub-populations optimally capture a binary test of a type of outcome for the sensitivity index based on different events with different time periods associated with different known attributes.

3. The system of claim 2 , wherein the different known attributes are contemporaneous to at least one of (1) the different events causing a binary disruption in the first entity's status quo, (2) an absence of the first event, and (3) the second event being less disruptive than the first event.

4. The system of claim 3 , wherein the different known attributes have values that are non-randomized, such that the first entity experiencing the first event and a second entity experiencing the second event exhibit materially different distributions of said values.

5. The system of claim 1 , wherein the sensitivity index is generated based on at least a first disruption type or a first target outcome.

6. The system of claim 1 , wherein a known attribute is determined based on historical data associated with a population of entities having been subjected to an event.

7. The system of claim 4 , wherein the population is divided into the first sub-population and the second sub-population based on a propensity score calculated for pairs of matched entities in the population.

8. The system of claim 1 , wherein the first event comprises a first medical treatment and the second event comprises a second medical treatment not including the first medical treatment.

9. The system of claim 1 , wherein the historical data comprises one or more of age, weight, body mass index, ethnic background, socio-economic factors, and health condition.

10. The system of claim 8 , wherein the sensitivity index predicts how sensitive a predicted health outcome for the first entity is depending on a potential future disruption in the first medical treatment.

11. A computer-implemented method executed by one or more processors, the method comprising:

using one or more processors coupled to one or more data storage devices to process or store data associated with known attributes for a plurality of entities subjected to a plurality of known events,

a machine learning model implemented as a data structure stored in the one or more data storage devices, the machine learning model trained to observe performances of the plurality of entities in a first sub-population and a second sub-population,

the machine learning model associated with a set of predictors and at least a binary indicator variable corresponding to a first entity subjected to a first event experience by members of the first sub-population,

the machine learning model trained to predict an expected performance for the first entity based on at least one of (1) a known attribute associated with the first entity in relation to the first event and (2) a value of the binary indicator variable associated with the first event,

members of the first sub-population and the second sub-population being distinguishable based on whether one or more events have been experienced by the members of the first sub-population and the second sub-population, the members of the first sub-population experiencing the first event and the members of the second sub-population experiencing a second event,

determining, by the one or more processors, an expected performance of the first entity subjected to the first event is determined based on a sensitivity value determined for the first entity by quantifying an expected performance of a member of the first sub-population subjected to the first event according to a sensitivity index generated based on different permutations of potential outcomes for the plurality of known events according to a weighted combination of outputs of multiple sensitivity index models focused on types of disruption or predicted outcomes, the sensitivity index models being generated based on disruption type or target outcome, and

administering a treatment to the first entity, responsive to the determined expected performance, wherein the sensitivity index predicts how sensitive a predicted outcome for the first entity is.

12. The method of claim 11 , wherein the first sub-population and the second sub-populations optimally capture a binary test of a type of outcome for the sensitivity index based on different events with different time periods associated with different known attributes.

13. The method of claim 12 , wherein the different known attributes are contemporaneous to at least one of (1) the different events causing a binary disruption in the first entity's status quo, (2) an absence of the first event, and (3) the second event being less disruptive than the first event.

14. The method of claim 13 , wherein the different known attributes have values that are non-randomized, such that the first entity experiencing the first event and a second entity experiencing the second event exhibit materially different distributions of said values.

15. The method of claim 11 , wherein the sensitivity index is generated based on at least a first disruption type or a first target outcome.

16. The method of claim 11 , wherein a known attribute is determined based on historical data associated with a population of entities having been subjected to an event.

17. The method of claim 16 , wherein the population is divided into the first sub-population and the second sub-population based on a propensity score calculated for pairs of matched entities in the population, the first event comprises a first medical treatment and the second event comprises a second medical treatment not including the first medical treatment, the historical data comprises one or more of age, weight, body mass index, ethnic background, socio-economic factors, and health condition, and the sensitivity index predicts how sensitive a predicted health outcome for the first entity is depending on a potential future disruption in the first medical treatment.

18. A non-transitory data storage medium capable of storing instructions that when executed by one or more processors cause a system to:

process or store data associated with known attributes for a plurality of entities subjected to a plurality of known events,

a machine learning model implemented as a data structure stored in one or more data storage devices, the machine learning model trained to observe performances of the plurality of entities in a first sub-population and a second sub-population,

the machine learning model associated with a set of predictors and at least a binary indicator variable corresponding to a first entity subjected to a first event experience by members of the first sub-population,

the machine learning model trained to predict an expected performance for the first entity based on at least one of (1) a known attribute associated with the first entity in relation to the first event and (2) a value of the binary indicator variable associated with the first event,

members of the first sub-population and the second sub-population being distinguishable based on whether one or more events have been experienced by the members of the first sub-population and the second sub-population, the members of the first sub-population experiencing the first event and the members of the second sub-population experiencing a second event,

determine an expected performance of the first entity subjected to the first event is determined based on a sensitivity value determined for the first entity by quantifying an expected performance of a member of the first sub-population subjected to the first event according to a sensitivity index generated based on different permutations of potential outcomes for the plurality of known events according to a weighted combination of outputs of multiple sensitivity index models focused on types of disruption or predicted outcomes, the sensitivity index models being generated based on disruption type or target outcome, and

a treatment being applied to the first entity, responsive to the determined expected performance, wherein the sensitivity index predicts how sensitive a predicted outcome for the first entity is.

19. The data storage medium of claim 18 , wherein the first sub-population and the second sub-populations optimally capture a binary test of a type of outcome for the sensitivity index based on different events with different time periods associated with different known attributes and the different known attributes are contemporaneous to at least one of (1) the different events causing a binary disruption in the first entity's status quo, (2) an absence of the first event, and (3) the second event being less disruptive than the first event.

20. The data storage medium of claim 19 , wherein the different known attributes have values that are non-randomized, such that the first entity experiencing the first event and a second entity experiencing the second event exhibit materially different distributions of said values, the sensitivity index is generated based on at least a first disruption type or a first target outcome, a known attribute is determined based on historical data associated with a population of entities having been subjected to an event, and the population of entities is divided into the first sub-population and the second sub-population based on a propensity score calculated for pairs of matched entities in the population of entities.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 8, 2025
From: FAHNER, GERALD; VANCHO, BRAD
To: FAIR ISAAC CORPORATION
Reel/Frame 071063/0419 →
Continuity (3)
Continuation 17469794 · Sep 8, 2021
Continuation In Part 15801265 · Nov 1, 2017
Related Publication 20240013919A1 · Jan 11, 2024
References Cited (20)
US 7840484B2 · Haggerty et al. · 2010 [cited by applicant]
US 8504456B2 · Griffin et al. · 2013 [cited by applicant]
US 8515862B2 · Zhang et al. · 2013 [cited by applicant]
US 11804302B2 · Fahner · 2023 [cited by examiner]
US 20050234688A1 · Pinto et al. · 2005 [cited by applicant]
US 20090037308A1 · Feinstein · 2009 [cited by applicant]
US 20110078073A1 · Annappindi · 2011 [cited by applicant]
US 20120246048A1 · Cohen et al. · 2012 [cited by applicant]
US 20130268468A1 · Vijayaraghavan et al. · 2013 [cited by applicant]
US 20170316511A1 · Chang · 2017 [cited by examiner]
US 20190130481A1 · Fahner et al. · 2019 [cited by applicant]
US 20190325354A1 · Rajnayak · 2019 [cited by examiner]
US 20210142910A1 · Hafez et al. · 2021 [cited by applicant]
US 20210241923A1 · Foschini · 2021 [cited by examiner]
US 20210264466A1 · Aggarwal et al. · 2021 [cited by applicant]
US 20210374033A1 · Yang et al. · 2021 [cited by applicant]
US 20220028561A1 · Klasson · 2022 [cited by applicant]
Fahner, G. “Estimating causal effects of credit decisions.” [cited by applicant]
Friedman, J.H. (Feb. 28, 2002, e-published Jan. 30, 2002). “Stochastic Gradient Boosting.” Computational Statistics and Data Analysis, 38(4):pp. 367-378. [cited by applicant]
Rosenbaum, P.R. and Rubin, D.B. “The Central Role of the Propensity Score in Observational Studies for Causal Effects.” Biometrika (1983), 70, (1), pp. 41-55. [cited by applicant]