IP Library Granted Patent US 11,301,766
Granted Patent B2
US 11,301,766 · App. 17/247,764 · Granted Apr 12, 2022

System and method for field value recommendations based on confidence levels in analyzed dataset

Inventors: Kristen Noriko Muramoto (San Francisco, CA); Son Thanh Chang (Oakland, CA); Clement Jacques Antoine Tussoit (San Francisco, CA); Melissa Hoang (San Francisco, CA); Chaitanya Malla (Fremont, CA); Orjan N. Kjellberg (Walnut Creek, CA); Carlos Enrique Mogollan Jimenez (San Francisco, CA); George Hu (San Francisco, CA)
Assignee: salesforce.com, inc.
G06N5/048G06F3/0482G06F3/04847G06F9/451G06N99/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,301,766
App. No.
17/247,764
Granted
Apr 12, 2022
Kind
B2
Abstract

A method of training a predictive model to predict a likely field value for one or more user selected fields within an application. The method comprises providing a user interface for user selection of the one or more user selected fields within the application; analyzing a pre-existing, user provided data set of objects; training, based on the analysis, the predictive model; determining, for each user selected field based on the analysis, a confidence function for the predictive model that identifies the percentage of cases predicted correctly at different applied confidence levels, the percentage of cases predicted incorrectly at different applied confidence levels, and the percentage of cases in which the prediction model could not provide a prediction at different applied confidence levels; and providing a user interface for user review of the confidence functions for user selection of confidence threshold levels to be used with the predictive model.

Claims (37)

1. A system for providing a predicted field value for one or more user selected fields in a form generated by an application, the system comprising a controller configured to:

analyze an object received by the application to identify one or more fields of a form the application is configured to generate;

predict using a predictive model a likely field value for at least one of the one or more fields and a confidence level for at least one of the one or more likely field values, the confidence level having been derived from a confidence function for at least one of the one or more fields, wherein:

a user provided data set of objects has been analyzed for relationships between the one or more user selected fields and content in the objects in the data set, and

the predictive model has been trained using machine learning techniques to predict the confidence function and the likely field value for the one or more fields when the application receives a new object based on the relationships between the one or more user selected fields and the content in the objects in the data set; and

provide to the application the predicted field value for at least one predicted field and the predicted confidence level;

wherein the application displays the form in a user interface with the predicted field value for the at least one predicted field and the predicted confidence level for the at least one predicted field value.

2. The system of claim 1 , wherein the application provides user-selectable field value choices for the fields and wherein the user-selectable field value choices are selected via a picklist, lookup or checkbox.

3. The system of claim 1 , further configured to provide, for user selection via a first user interface, an option for the predictive model to identify a predicted field value as a best recommendation.

4. The system of claim 3 , wherein a confidence threshold level is used to determine the best recommendation, wherein predicted field values determined by the predictive model that have an associated confidence level that is below the confidence threshold level will not be recommended as a best recommendation and predicted field values determined by the predictive model that have an associated confidence level that is equal to or above the confidence threshold level will be recommended by the predictive model as a best recommendation via a visual indication.

5. The system of claim 3 , further configured to provide an option, for user selection via the first user interface, for the predictive model to automatically apply the best recommendation as a field value without user confirmation of the application of the best recommendation as a field value.

6. The system of claim 1 , further configured to recommend a confidence threshold level.

7. The system of claim 1 , further configured to provide an option, via a first user interface, to activate the predictive model for use with the application.

8. A method for providing a predicted field value for one or more user selected fields in a form generated by an application, the method comprising:

analyzing an object received by the application to identify one or more fields of a form the application is configured to generate;

predicting using a predictive model a likely field value for at least one of the one or more fields and a confidence level for at least one of the one or more likely field values, the confidence level having been derived from a confidence function for at least one of the one or more fields, wherein:

a user provided data set of objects has been analyzed for relationships between the one or more user selected fields and content in the objects in the data set, and

the predictive model has been trained using machine learning techniques to predict the confidence function and the likely field value for the one or more fields when the application receives a new object based on the relationships between the one or more user selected fields and the content in the objects in the data set;

providing to the application the predicted field value for at least one predicted field and the predicted confidence level; and

displaying, by the application, the form in a user interface with the predicted field value for the at least one predicted field and the predicted confidence level for the at least one predicted field value.

9. The method of claim 8 , further comprising providing, for user selection via a first user interface, an option for the predictive model to identify a predicted field value as a best recommendation.

10. The method of claim 9 , further comprising applying a confidence threshold level to determine the best recommendation, wherein predicted field values determined by the predictive model that have an associated confidence level that is below the confidence threshold level will not be recommended as a best recommendation and predicted field values determined by the predictive model that have an associated confidence level that is equal to or above the confidence threshold level will be recommended by the predictive model as a best recommendation via a visual indication.

11. The method of claim 9 , further comprising providing an option, for user selection via the first user interface, for the predictive model to automatically apply the best recommendation as a field value without user confirmation of the application of the best recommendation as a field value.

12. The method of claim 8 , further comprising automatically recommending a confidence threshold level.

13. The method of claim 8 , further comprising providing an option, via a first user interface, to activate the predictive model for use with the application.

14. The method of claim 8 , wherein the application provides user-selectable field value choices for the fields and wherein the user-selectable field value choices are selected via a picklist, lookup or checkbox.

15. Non-transitory computer readable media comprising programming instructions configurable to cause a processor to perform a method for providing a predicted field value for one or more user selected fields in a form generated by an application, the method comprising:

analyzing an object received by the application to identify one or more fields of a form the application is configured to generate;

predicting using a predictive model a likely field value for at least one of the one or more fields and a confidence level for at least one of the one or more likely field values, the confidence level having been derived from a confidence function for at least one of the one or more fields, wherein:

a user provided data set of objects has been analyzed for relationships between the one or more user selected fields and content in the objects in the data set, and

the predictive model has been trained using machine learning techniques to predict the confidence function and the likely field value for the one or more fields when the application receives a new object based on the relationships between the one or more user selected fields and the content in the objects in the data set; and

providing the predicted field value for at least one predicted field and a predicted confidence level derived from the confidence function for at least one predicted field value to the application for display, by the application, in a user interface when the form is displayed.

16. The non-transitory computer readable media of claim 15 , wherein the method further comprises providing, for user selection via a first user interface, an option for the predictive model to identify a predicted field value as a best recommendation.

17. The non-transitory computer readable media of claim 16 , wherein the method further comprises applying a confidence threshold level to determine the best recommendation, wherein predicted field values determined by the predictive model that have an associated confidence level that is below the confidence threshold level will not be recommended as a best recommendation and predicted field values determined by the predictive model that have an associated confidence level that is equal to or above the confidence threshold level will be recommended by the predictive model as a best recommendation via a visual indication.

18. The non-transitory computer readable media of claim 16 , wherein the method further comprises providing an option, for user selection via the first user interface, for the predictive model to automatically apply the best recommendation as a field value without user confirmation of the application of the best recommendation as a field value.

19. The non-transitory computer readable media of claim 15 , wherein the method further comprises automatically recommending a confidence threshold level.

20. The non-transitory computer readable media of claim 15 , wherein the method further comprises providing an option, via a first user interface, to activate the predictive model for use with the application.

Assignments (2)
CHANGE OF NAME Recorded Dec 18, 2024
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 069717/0529 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2020
From: MURAMOTO, KRISTEN NORIKO; CHANG, SON THANH; TUSSOIT, CLEMENT JACQUES ANTOINE; HOANG, MELISSA; MALLA, CHAITANYA; KJELLBERG, ORJAN N.; JIMENEZ, CARLOS ENRIQUE MOGOLLAN; HU, GEORGE
To: SALESFORCE.COM, INC.
Reel/Frame 054727/0586 →
Continuity (3)
Continuation 16198449 · Nov 21, 2018
Provisional Application 62735813 · Sep 24, 2018
Related Publication 20210182716A1 · Jun 17, 2021
Cited By (15)
US 12,197,712 US 12,197,817 US 12,200,297 US 12,236,952 US 12,301,635 US 12,333,404 US 12,361,943 US 12,367,879 US 12,386,434 US 12,386,491 US 12,477,470 US 12,608,171 US 12,632,442 US 12,645,674 US 12,670,151