IP Library › Granted Patent US 10,783,405
Granted Patent B2
US 10,783,405 · App. 16/176,760 · Granted Sep 22, 2020

Refinement of machine learning engines for automatically generating component-based user interfaces

Inventors: Sonke Rohde (San Francisco, CA); Brian J. Lonsdorf (Belmont, CA)
Assignee: salesforce.com, inc.
G06K9/6263G06F8/38G06F40/14G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,783,405
App. No.
16/176,760
Granted
Sep 22, 2020
Kind
B2
Abstract

Techniques are disclosed relating to refining, based on user feedback, one or more machine learning engines for automatically generating component-based user interfaces. In various embodiments, a computer system stores template information that defines a plurality of component types and one or more display parameters identified for one or more user interfaces. The computer system may receive a request to generate a user interface, where the request specifies a data set to be displayed. Further, the computer system may automatically generate a user interface, where the generating is performed by one or more machine learning engines that use the template information and the data set as inputs. The computer system may then provide the user interface to one or more users, receive user feedback associated with the user interface, and train at least one of the one or more machine learning engines based on the user feedback.

Claims (55)

1. A method, comprising:

storing, by a computing system, template information that defines a plurality of component types and one or more display parameters identified for one or more user interfaces, wherein a component type specifies a set of one or more user interface element types included in a given component, and wherein a display parameter specifies how one or more components are to be displayed;

receiving, by the computing system, a request to automatically generate a user interface, wherein the request specifies a data set to be displayed using the user interface;

automatically generating, by the computer system, at least one user interface in response to the request, wherein the generating is performed by one or more machine learning engines that use the template information and the data set as inputs;

providing, by the computer system, the at least one user interface to one or more users;

receiving, by the computer system, user feedback associated with the at least one user interface, wherein the user feedback includes data corresponding to user interaction, with the at least one user interface, of a particular set of one or more users; and

selectively training at least one of the one or more machine learning engines based on the data corresponding to the user interaction, with the at least one user interface, of the particular set of one or more users.

2. The method of claim 1 , wherein the at least one user interface includes:

a selection of one or more component types through which to display the data set; and

an arrangement of one or more components, corresponding to the one or more component types, displaying the data set in one or more user interface elements.

3. The method of claim 1 , wherein the automatically generating the at least one user interface comprises:

automatically selecting a plurality of suggested component types for a subset of the data set;

wherein the user feedback indicates one of the plurality of suggested component types.

4. The method of claim 3 , further comprising:

automatically generating, for the plurality of suggested component types, a corresponding plurality of representative components;

causing display of a particular user interface that includes the corresponding plurality of representative components, wherein each of the corresponding plurality of representative components depicts the subset of the data set; and

receiving, by the computer system, input indicating a selected component type of the plurality of suggested component types, wherein the at least one user interface, provided to the one or more users, includes at least a portion of the data set depicted using the selected component type.

5. The method of claim 1 , wherein the data corresponding to the user interaction includes at least one of click data for one or more user interface elements included in the at least one user interface, or hover data for one or more user interface elements included in the at least one user interface.

6. The method of claim 1 , wherein the particular set of one or more users includes a particular user, wherein the method further comprises:

based on the data corresponding to the user interaction of the particular user, generating a profile for the particular user, wherein the profile is used as an input for at least one of the one or more machine learning engines.

7. The method of claim 1 , wherein the providing the at least one user interface to the one or more users comprises:

providing, to the one or more users, the at least one user interface in a first interactive format; and

providing, to the one or more users, the at least one user interface in a second, different interactive format;

wherein the user feedback includes data specifying an interactive format used by the one or more users to interact with the at least one user interface.

8. The method of claim 1 , further comprising:

modifying, by the computer system, the template information based on the user feedback.

9. A non-transitory computer-readable medium having instructions stored thereon that are capable of execution by a computing device to perform operations comprising:

storing template information that defines a plurality of component types and one or more display parameters identified for one or more user interfaces, wherein a component type specifies a set of one or more user interface element types included in a given component, and wherein a display parameter specifies how one or more components are to be displayed;

receiving a request to automatically generate a user interface, wherein the request specifies a data set to be displayed using the user interface;

automatically generating at least one user interface in response to the request, wherein the generating is performed by one or more machine learning engines that use the template information and the data set as inputs;

providing the at least one user interface to one or more users;

receiving user feedback associated with the at least one user interface, wherein the user feedback includes data corresponding to user interaction, with the at least one user interface, of a particular set of one or more users; and

selectively training at least one of the one or more machine learning engines based on the data corresponding to the user interaction, with the at least one user interface, of the particular set of one or more users.

10. The non-transitory computer-readable medium of claim 9 , wherein the automatically generating the at least one user interface comprises:

automatically selecting a plurality of suggested component types for a subset of the data set;

wherein the user feedback indicates one of the plurality of suggested component types.

11. The non-transitory computer-readable medium of claim 10 , wherein the operations further comprise:

automatically generating, for the plurality of suggested component types, a corresponding plurality of representative components;

causing display of a particular user interface that includes the corresponding plurality of representative components, wherein each of the corresponding plurality of representative components depicts the subset of the data set; and

receiving input indicating a selected component type of the plurality of suggested component types, wherein the at least one user interface, provided to the one or more users, includes at least a portion of the data set depicted using the selected component type.

12. The non-transitory computer-readable medium of claim 9 , wherein the data corresponding to the user interaction includes at least one of click data for one or more user interface elements included in the at least one user interface, or hover data for one or more user interface elements included in the at least one user interface.

13. The non-transitory computer-readable medium of claim 9 , wherein the operations further comprise:

based on the data corresponding to the user interaction of the particular set of one or more users, generating a profile for the particular set of one or more users, wherein the profile is used as an input for the at least one of the one or more machine learning engines.

14. A system, comprising:

at least one processor; and

a non-transitory, computer-readable medium having instructions stored thereon that are executable by the at least one processor to cause the system to perform operations, the operations comprising:

storing template information that defines a plurality of component types and one or more display parameters identified for one or more user interfaces, wherein a component type specifies a set of one or more user interface element types included in a given component, and wherein a display parameter specifies how one or more components are to be displayed;

receiving a request to automatically generate a user interface, wherein the request specifies a data set to be displayed using the user interface;

automatically generating at least one user interface in response to the request, wherein the generating is performed by one or more machine learning engines that use the template information and the data set as inputs;

providing the at least one user interface to one or more users;

receiving user feedback associated with the at least one user interface, wherein the user feedback includes data corresponding to user interaction, with the at least one user interface, of a particular set of one or more users; and

selectively training at least one of the one or more machine learning engines based on the data corresponding to the user interaction, with the at least one user interface, of the particular set of one or more users.

15. The system of claim 14 , wherein the automatically generating the at least one user interface comprises:

automatically selecting a plurality of suggested component types for a subset of the data set;

wherein the user feedback indicates one of the plurality of suggested component types.

Assignments (2)
CHANGE OF NAME Recorded Aug 4, 2026
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 076118/0548 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2019
From: ROHDE, SONKE; LONSDORF, BRIAN J.
To: SALESFORCE.COM, INC.
Reel/Frame 048909/0595 →
Continuity (1)
Related Publication 20200134388A1 · Apr 30, 2020
Cited By (5)
US 12,198,714 US 12,265,947 US 12,423,513 US 12,450,420 US 12,596,557