IP Library Granted Patent US 12,481,919
Granted Patent B2
US 12,481,919 · App. 17/728,259 · Granted Nov 25, 2025

Discrimination likelihood estimate for trained machine learning model

Inventor: Jacques Doan Huu (Montigny le Bretonneux, FR)
Assignee: BUSINESS OBJECTS SOFTWARE LTD.
G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,481,919
App. No.
17/728,259
Granted
Nov 25, 2025
Kind
B2
Abstract

Systems and methods include reception of a plurality of records, each of the plurality of records associating each of a plurality of features with a respective value, a second feature with a value, and a target feature with a value, a first machine learning model trained based on the plurality of records to output a value of the target feature based on values of each of the plurality of features, a second machine learning model trained based on the plurality of records to output a value of the second feature based on the values of each of the plurality of features, determination, based on the trained second machine learning model, of a first one or more of the plurality of features which are correlated to the second feature, determination of an influence of each of the first one or more features on the trained first machine learning model, and determination of a first value associated with the second feature based on the determined influences and on the trained second machine learning model.

Claims (86)

1 . A system comprising:

a memory storing processor-executable program code; and

at least one processing unit to execute the processor-executable program code to cause the system to:

determine a plurality of records, each of the plurality of records associating each of a plurality of features with a respective value, a second feature with a second feature value, and a target feature with a target value;

train a first machine learning model based on the plurality of records to output an inferred target value of the target feature based on first input values of each of the plurality of features;

train a second machine learning model based on the plurality of records to output an inferred second feature value of the second feature based on the second input values of each of the plurality of features;

determine, based on the trained second machine learning model, a first one or more of the plurality of features which are correlated to the second feature;

determine an influence of each of the first one or more features on the trained first machine learning model;

determine a first value indicating a discrimination likelihood of the trained first machine learning model with respect to the second feature based on the determined influences and on the trained second machine learning model;

receive a command to cancel generation of the trained first machine learning model based on the discrimination likelihood; and

in response to the received command, cancel generation of the trained first machine learning model.

2 . A system according to claim 1 , wherein determination of the first one or more of the plurality of features which are correlated to the second one of the first plurality of features comprises determination of one or more of the plurality of features having a greatest influence on the trained second machine learning model.

3 . A system according to claim 2 , the at least one processing unit to execute the processor-executable program code to cause the system to:

train a third machine learning model based on the plurality of records to output an inferred value of a third feature based on third input values of each of the plurality of features except for the third feature and the second feature;

determine, based on the trained third machine learning model, a second one or more of the plurality of features which are correlated to the third feature;

determine an influence of each of the second one or more features on the trained first machine learning model; and

determine a second value indicating a discrimination likelihood of the trained first machine learning model with respect to the third feature based on the determined influences of each of the second one or more features and on the trained third machine learning model; and

determine a composite value associated with the trained first machine learning model based on the first value and the second value.

4 . A system according to claim 3 , the at least one processing unit to execute the processor-executable program code to cause the system to:

determine, based on the trained second machine learning model, a first probability associated with a category of the second feature; and

determine, based on the trained third machine learning model, a second probability associated with a category of the third feature,

wherein determination of the first value is based on the first probability and on the determined influences of each of the first one or more features, and

wherein determination of the second value is based on the second probability and on the determined influences of each of the second one or more features.

5 . A system according to claim 2 , the at least one processing unit to execute the processor-executable program code to cause the system to:

determine, based on the trained second machine learning model, a first probability associated with a category of the second feature,

wherein determination of the first value is based on the determined influences and the first probability.

6 . A system according to claim 2 , wherein training of the second machine learning model comprises:

converting all second feature values of the second feature into either one of a discriminated category and a non-discriminated category.

7 . A system according to claim 6 , the at least one processing unit to execute the processor-executable program code to cause the system to:

determine, based on the trained second machine learning model, a first probability associated with a category of the second feature,

wherein determination of the first value is based on the determined influences and the first probability.

8 . A method comprising:

receiving a plurality of records, each of the plurality of records associating each of a plurality of features with a respective value, a second feature with a second feature value, and a target feature with a target value;

training a first machine learning model based on the plurality of records to output an inferred target value of the target feature based on first input values of each of the plurality of features;

training a second machine learning model based on the plurality of records to output an inferred second feature value of the second feature based on second input values of each of the plurality of features;

determining, based on the trained second machine learning model, a first one or more of the plurality of features which are correlated to the second feature;

determining an influence of each of the first one or more features on the trained first machine learning model;

determining a first discrimination likelihood of the trained first machine learning model with respect to the second feature based on the determined influences and on the trained second machine learning model;

receiving a command to cancel generation of the trained first machine learning model based on the discrimination likelihood; and

in response to the received command, cancelling generation of the trained first machine learning model.

9 . A method according to claim 8 , wherein determining the first one or more of the plurality of features which are correlated to the second one of the first plurality of features comprises determining of one or more of the plurality of features having a greatest influence on the trained second machine learning model.

10 . A method according to claim 9 , further comprising:

training a third machine learning model based on the plurality of records to output a value of a third feature based on third input values of each of the plurality of features except for the third feature and the second feature;

determining, based on the trained third machine learning model, a second one or more of the plurality of features which are correlated to the third feature;

determining an influence of each of the second one or more features to the trained first machine learning model; and

determining a second value indicating a discrimination likelihood of the trained first machine learning model with respect to the third feature based on the determined influences of each of the second one or more features and based on the trained third machine learning model; and

determining a composite discrimination likelihood associated with the trained first machine learning model based on the first value and the second value.

11 . A method according to claim 10 , further comprising:

determining, based on the trained second machine learning model, a first probability associated with a category of the second feature; and

determining, based on the trained third machine learning model, a second probability associated with a category of the third feature,

wherein determining the first value is based on the first probability and the determined influences on the trained second machine learning model, and

wherein determining the second value is based on the determined influences on the trained third machine learning model and the second probability.

12 . A method according to claim 8 , further comprising:

determining, based on the trained second machine learning model, a first probability associated with a category of the second feature,

wherein determining the first value is based on the determined influences and the first probability.

13 . A method according to claim 9 , wherein training of the second machine learning model comprises:

converting all second feature values of the second feature into either one of a discriminated category and a non-discriminated category.

14 . A method according to claim 13 , further comprising:

determining, based on the trained second machine learning model, a first probability associated with a category of the second feature,

wherein determining the first value is based on the determined influences and the first probability.

15 . A non-transitory medium storing executable program code executable by at least one processing unit of a computing system to cause the computing system to:

receive a plurality of records, each of the plurality of records associating each of a plurality of features with a respective value, a second feature with a second feature value, and a target feature with a target value;

train a first machine learning model based on the plurality of records to output an inferred target value of the target feature based on first input values of each of the plurality of features;

train a second machine learning model based on the plurality of records to output an inferred second feature value of the second feature based on second input values of each of the plurality of features;

determine, based on the trained second machine learning model, a first one or more of the plurality of features which are correlated to the second feature;

determine an influence of each of the first one or more features on the trained first machine learning model;

determine a first value indicating a discrimination likelihood of the trained first machine learning model with respect to the second feature based on the determined influences and on the trained second machine learning model;

receive a command to cancel generation of the trained first machine learning model based on the discrimination likelihood; and

in response to the received command, cancel generation of the trained first machine learning model.

16 . A medium according to claim 15 , wherein determination of the first one or more of the plurality of features which are correlated to the second one of the first plurality of features comprises determination of one or more of the plurality of features having a greatest influence on the trained second machine learning model.

17 . A medium according to claim 16 , the program code executable by at least one processing unit of a computing system to cause the computing system to:

train a third machine learning model based on the plurality of records to output an inferred value of a third feature based on third input values of each of the plurality of features except for the third feature and the second feature;

determine, based on the trained third machine learning model, a second one or more of the plurality of features which are correlated to the third feature;

determine an influence of each of the second one or more features on the trained first machine learning model;

determine a second value indicating a discrimination likelihood of the trained first machine learning model with respect to the third feature based on the determined influences of each of the second one or more features and on the trained third machine learning model; and

determine a composite value associated with the trained first machine learning model based on the first value and the second value.

18 . A medium according to claim 17 , the program code executable by at least one processing unit of a computing system to cause the computing system to:

determine, based on the trained second machine learning model, a first probability associated with a category of the second feature; and

determine, based on the trained third machine learning model, a second probability associated with a category of the third feature,

wherein determination of the first value is based on the first probability and on the determined influences of each of the first one or more features, and

wherein determination of the second value is based on the second probability and on the determined influences of each of the second one or more features.

19 . A medium according to claim 16 , the program code executable by at least one processing unit of a computing system to cause the computing system to:

determine, based on the trained second machine learning model, a first probability associated with a category of the second feature,

wherein determination of the first value is based on the determined influences and the first probability.

20 . A medium according to claim 16 , wherein training of the second machine learning model comprises:

converting all second feature values of the second feature into either one of a discriminated category and a non-discriminated category.

Assignments (2)
CHANGE OF NAME Recorded Jan 26, 2026
From: BUSINESS OBJECTS SOFTWARE LIMITED
To: SAP IRELAND LIMITED
Reel/Frame 074510/0354 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2022
From: DOAN HUU, JACQUES
To: BUSINESS OBJECTS SOFTWARE LTD
Reel/Frame 059698/0545 →
Continuity (1)
Related Publication 20230342659A1 · Oct 26, 2023
References Cited (2)
US 20200302309A1 · Golding · 2020 [cited by examiner]
US 20230115067A1 · Cmielowski · 2023 [cited by examiner]