IP Library Granted Patent US 12,511,139
Granted Patent B2
US 12,511,139 · App. 17/841,766 · Granted Dec 30, 2025

Interface for generating models with customizable interface configurations

Inventors: Arijit Sengupta (San Francisco, CA); Jonathan Wray (San Francisco, CA); Grigory Nudelman (San Francisco, CA); Daniel Kane (San Francisco, CA); Geoffrey Grant (San Francisco, CA)
Assignee: Aible Inc.
G06F9/453G06F3/0482G06N5/04G06Q10/06312G06Q10/0633
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,511,139
App. No.
17/841,766
Granted
Dec 30, 2025
Kind
B2
Abstract

A method includes receiving, via a model building platform, historical user behavior including historical data analysis characteristics; generating, based on the historical data analysis characteristics, a blueprint for guiding user action to accomplish a task, the generating including constructing the blueprint using the historical data analysis characteristics; receiving, via graphical user interface, user input requesting generation of a model and a task description; determining, using the blueprint and based on the task description, data analysis characteristics; and rendering, within the graphical user interface, a prompt to select the determined data analysis characteristics. Related apparatus, systems, techniques and articles are also described.

Claims (56)

1 . A method comprising:

receiving historical user behavior including historical data analysis characteristics;

generating, based on the historical data analysis characteristics, a file or set of files specifying a description of a bias field tag, wherein the bias field tag is indicative of a discriminatory bias associated with a data field in the generated file or set of files;

receiving a request to generate at least one of a predictive model, an optimization model, and/or a prescriptive model, and a task description for the predictive model, the optimization model, and/or the prescriptive model;

providing, on a user interface, a recommendation for generating the predictive model, the optimization model, and/or the prescriptive model based at least on the bias field tag;

receiving, via the user interface, user feedback on the provided recommendation; and

generating, using the file or set of files and the received user feedback, the predictive model, the optimization model, and/or the prescriptive model, the generating including training the predictive model, the optimization model, and/or the prescriptive model with a dataset.

2 . The method of claim 1 , wherein the historical user behavior is obtained from identified enterprise integrations.

3 . The method of claim 1 , wherein the file or set of files specify user interface configuration parameters, the user interface configuration parameters including an automated variable mapping that characterizes variable headers of a dataset and maps the variable headers to a specific explanatory variable in the file or set of files.

4 . The method of claim 1 , wherein the file or set of files specify user interface configuration parameters, the user interface configuration parameters including an actionability tag identifying a variable to change to influence an outcome; the method further comprising:

generating a recommendation based on the actionability tag.

5 . The method of claim 1 , wherein the file or set of files specify user interface configuration parameters, the user interface configuration parameters including a tag for a directional preference for an explanatory variable; the method further comprising:

generating a recommendation based on the tag.

6 . The method of claim 1 , further comprising determining data analysis characteristics, the determining the data analysis characteristics includes identifying variables in a dataset, identifying data sources to form the dataset, identifying a data granularity, and identifying rows and/or columns in the dataset to include and/or exclude.

7 . The method of claim 1 , wherein the historical data analysis characteristics includes metadata characterizing historical variables used; derived variables; historical data sources used; historical data granularity; historical data columns and/or rows to exclude and/or include; historical tasks performed by users; or a combination thereof.

8 . The method of claim 7 , wherein the generating includes using a model trained with the metadata to automatically generate a blueprint.

9 . The method of claim 7 , wherein the data analysis characteristics include a variable, a data source, a data granularity, a data column and/or row to exclude and/or include, and historical tasks performed by users.

10 . The method of claim 9 , the generating the predictive model, the optimization model, and/or the prescriptive model including training the model with a dataset according to the data analysis characteristics, the dataset including the variable obtained from the data source at the data granularity.

11 . The method of claim 7 , further comprising:

determining a performance of the predictive model, the optimization model, and/or the prescriptive model, the determining including determining a first performance value of the predictive model, the optimization model, and/or the prescriptive model;

rendering, within a graphical user interface, a plot including a first axis and a second axis, the first axis including a characterization of a first performance metric and the second axis including a characterization of a second performance metric; and

rendering, within the graphical user interface and the plot, a first graphical object at a first location characterizing the first performance value.

12 . The method of claim 11 , further comprising:

rendering a first line indicative of random model performance, a second line indicative of constant accuracy, and/or a third line indicative of constant cost,

wherein the first performance metric includes rate of false positive, count of false positive, cost of false positive, benefit missed by false positive, true positive, benefit of true positive, benefit of minimizing false positive, benefit of maximizing true positive, or a combination thereof;

wherein the second performance metric includes rate of false negative, count of false negative, cost of false negative, benefit missed by false negative, true negative, benefit of true negative, benefit of minimizing false negative, benefit of maximizing true negative, or a combination thereof.

13 . The method of claim 12 , further comprising:

rendering a first line indicative of target accuracy, a second line indicative of constant accuracy, and a third line indicative of constant cost; and receiving data characterizing a target accuracy; rendering a region indicative of the target accuracy, the region indicative of the target accuracy bounded by at least:

the first line indicative of the target accuracy and an origin of the plot;

a second line indicative of constant accuracy and the origin; or

a second line indicative of constant accuracy, the third line indicative of constant cost, and the origin;

wherein the first performance metric includes rate of false positive, count of false positive, cost of false positive, benefit missed by false positive, true positive, benefit of true positive, benefit of minimizing false positive, benefit of maximizing true positive, or a combination thereof;

wherein the second performance metric includes rate of false negative, count of false negative, cost of false negative, benefit missed by false negative, true negative, benefit of true negative, benefit of minimizing false negative, benefit of maximizing true negative, or a combination thereof.

14 . The method of claim 1 , wherein the generated file or set of files further comprises a description of at least one of an outcome variable, a use case specific text, a use case specific process flow or description.

15 . The method of claim 14 , wherein the file or set of files further specify user interface configuration parameters.

16 . The method of claim 15 , wherein the configuration parameters include a type of intended use case; a type of an outcome variable; an explanatory variable; a type of the explanatory variable; a data storage location for the explanatory variable; an automated variable mapping; an automated creation of variables; an automated variable classification; a use case specific input option; an actionability tag; an indication of positive and/or negative impact on the explanatory variable; a variable specific language tag; a variable specific language scale; or a combination thereof.

17 . A system comprising:

at least one data processor; and

memory storing instructions, which when executed by the at least one data processor, cause the at least one data processor to perform operations comprising:

receiving historical user behavior including historical data analysis characteristics;

generating, based on the historical data analysis characteristics, a file or set of files specifying a description of a bias field tag, wherein the bias field tag is indicative of a discriminatory bias associated with a data field in the generated file or set of files;

receiving a request to generate at least one of a predictive model, an optimization model, and/or a prescriptive model, and a task description for the predictive model, the optimization model, and/or the prescriptive model;

providing, on a user interface, a recommendation for generating the predictive model, the optimization model, and/or the prescriptive model based at least on the bias field tag;

receiving, via the user interface, user feedback on the provided recommendation; and

generating, using the file or set of files and the received user feedback, the predictive model, the optimization model, and/or the prescriptive model, the generating including training the predictive model, the optimization model, and/or the prescriptive model with a dataset.

18 . The system of claim 17 , wherein the historical user behavior is obtained from identified enterprise integrations.

19 . The system of claim 17 , wherein the generated file or set of files further comprises a description of at least one of an outcome variable, a use case specific text, a use case specific process flow or description.

20 . The system of claim 19 , wherein the file or set of files specify user interface configuration parameters.

21 . The system of claim 20 , wherein the configuration parameters include a type of intended use case; a type of an outcome variable; an explanatory variable; a type of the explanatory variable; a data storage location for the explanatory variable; an automated variable mapping; an automated creation of variables; an automated variable classification; a use case specific input option; an actionability tag; an indication of positive and/or negative impact on the explanatory variable; a variable specific language tag; a variable specific language scale; or a combination thereof.

22 . A non-transitory computer readable medium storing instructions which, when executed by at least one data processor, cause the at least one data processor to perform operations comprising:

receiving historical user behavior including historical data analysis characteristics;

generating, based on the historical data analysis characteristics, a file or set of files specifying a description of a bias field tag, wherein the bias field tag is indicative of a discriminatory bias associated with a data field in the generated file or set of files;

receiving a request to generate at least one of a predictive model, an optimization model, and/or a prescriptive model, and a task description for the predictive model, the optimization model, and/or the prescriptive model;

providing, on a user interface, a recommendation for generating the predictive model, the optimization model, and/or the prescriptive model based at least one the bias field tag;

receiving, via the user interface, user feedback on the provided recommendation; and

generating, using the file or set of files and the received user feedback, the predictive model, the optimization model, and/or the prescriptive model, the generating including training the predictive model, the optimization model, and/or the prescriptive model with a dataset.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 4, 2022
From: SENGUPTA, ARIJIT; WRAY, JONATHAN; NUDELMAN, GRIGORY; KANE, DANIEL; GRANT, GEOFFREY
To: AIBLE INC.
Reel/Frame 061298/0554 →
Continuity (4)
Continuation 16290470 · Mar 1, 2019
Continuation In Part 16169208 · Oct 24, 2018
Provisional Application 62745966 · Oct 15, 2018
Related Publication 20220308904A1 · Sep 29, 2022
References Cited (70)
US 7797313B1 · Goyal · 2010 [cited by examiner]
US 9336483B1 · Abeysooriya et al. · 2016 [cited by applicant]
US 10209974B1 · Patton et al. · 2019 [cited by applicant]
US 10467339B1 · Shen · 2019 [cited by examiner]
US 10586164B1 · Sengupta et al. · 2020 [cited by applicant]
US 10810512B1 · Wubbels et al. · 2020 [cited by applicant]
US 10817647B1 · Johnson et al. · 2020 [cited by applicant]
US 10936768B2 · Sengupta et al. · 2021 [cited by applicant]
US 11227047B1 · Vashisht et al. · 2022 [cited by applicant]
US 11409549B2 · Sengupta et al. · 2022 [cited by applicant]
US 11429508B2 · Sengupta et al. · 2022 [cited by applicant]
US 11892932B2 · Sengupta et al. · 2024 [cited by applicant]
US 20050234697A1 · Pinto et al. · 2005 [cited by applicant]
US 20070299833A1 · Viljamaa · 2007 [cited by examiner]
US 20090299896A1 · Zhang et al. · 2009 [cited by applicant]
US 20100153330A1 · Desikachari · 2010 [cited by applicant]
US 20100196941A1 · Braun et al. · 2010 [cited by applicant]
US 20100205521A1 · Folting · 2010 [cited by examiner]
US 20110161857A1 · Kramer · 2011 [cited by applicant]
US 20110225584A1 · Andrade et al. · 2011 [cited by applicant]
US 20110231499A1 · Stovicek et al. · 2011 [cited by applicant]
US 20120198342A1 · Mahmud · 2012 [cited by examiner]
US 20130041860A1 · Lawrence et al. · 2013 [cited by applicant]
US 20130055268A1 · Amershi · 2013 [cited by examiner]
US 20130198569A1 · Eidelman · 2013 [cited by applicant]
US 20140315742A1 · Blakely et al. · 2014 [cited by applicant]
US 20150039552A1 · Moyne · 2015 [cited by applicant]
US 20150269244A1 · Qamar et al. · 2015 [cited by applicant]
US 20160203509A1 · Sharp et al. · 2016 [cited by applicant]
US 20160232457A1 · Gray et al. · 2016 [cited by applicant]
US 20160350671A1 · Morris et al. · 2016 [cited by applicant]
US 20160350673A1 · Kumar et al. · 2016 [cited by applicant]
US 20160350870A1 · Morin et al. · 2016 [cited by applicant]
US 20160371601A1 · Grove et al. · 2016 [cited by applicant]
US 20170004584A1 · Wang et al. · 2017 [cited by applicant]
US 20170090990A1 · Furman et al. · 2017 [cited by applicant]
US 20170148027A1 · Yu et al. · 2017 [cited by applicant]
US 20170184602A1 · Martini et al. · 2017 [cited by applicant]
US 20170368258A1 · Fleischer · 2017 [cited by applicant]
US 20180046926A1 · Achin et al. · 2018 [cited by applicant]
US 20180046935A1 · Amershi et al. · 2018 [cited by applicant]
US 20180067118A1 · Kim et al. · 2018 [cited by applicant]
US 20180080937A1 · Brenner et al. · 2018 [cited by applicant]
US 20180137424A1 · Gabaldon Royval · 2018 [cited by examiner]
US 20180248905A1 · Côté et al. · 2018 [cited by applicant]
US 20180260920A1 · Saratsis et al. · 2018 [cited by applicant]
US 20180277246A1 · Zhong · 2018 [cited by examiner]
US 20180321421A1 · Halabe et al. · 2018 [cited by applicant]
US 20180322951A1 · Vairavan et al. · 2018 [cited by applicant]
US 20180346151A1 · Sturlaugson et al. · 2018 [cited by applicant]
US 20180351972A1 · Yu et al. · 2018 [cited by applicant]
US 20180357557A1 · Williams · 2018 [cited by examiner]
US 20190087071A1 · Hournbuckle et al. · 2019 [cited by applicant]
US 20190112659A1 · Carrell et al. · 2019 [cited by applicant]
US 20190318266A1 · Kim et al. · 2019 [cited by applicant]
US 20200004863A1 · Kumar et al. · 2020 [cited by applicant]
US 20200068759A1 · Cvijetinovic et al. · 2020 [cited by applicant]
US 20200117490A1 · Sengupta et al. · 2020 [cited by applicant]
US 20200117765A1 · Sengupta et al. · 2020 [cited by applicant]
US 20200118018A1 · Sengupta et al. · 2020 [cited by applicant]
US 20200118019A1 · Sengupta et al. · 2020 [cited by applicant]
US 20200160998A1 · Ward et al. · 2020 [cited by applicant]
US 20200178875A1 · Ojeda et al. · 2020 [cited by applicant]
US 20200199676A1 · Meng et al. · 2020 [cited by applicant]
US 20200233315A1 · Nije · 2020 [cited by examiner]
US 20200386762A1 · Müller et al. · 2020 [cited by applicant]
US 20210113673A1 · Boucher et al. · 2021 [cited by applicant]
US 20210141976A1 · Sengupta et al. · 2021 [cited by applicant]
US 20220342793A1 · Sengupta et al. · 2022 [cited by applicant]
Drummond et al. (Aug. 2000) “Explicitly Representing Expected Cost: An Alternative to ROC Representation”, Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 198-207. [cited by applicant]