IP Library Granted Patent US 10,140,384
Granted Patent B2
US 10,140,384 · App. 14/619,553 · Granted Nov 27, 2018

Dynamically modifying elements of user interface based on knowledge graph

Inventors: Sailesh Kumar Sathish (Bangalore, IN); Nirmesh Neema (Indore, IN); Bhavani Shankar Yeleswarapu (Vijayawada, IN); Ravitheja Tetali (Visakhapatnam, IN); Satnam Singh (Bangalore, IN)
Assignee: Samsung Electronics Co., Ltd.
G06F17/30958G06F3/04847G06F3/04883G06F9/4451G06F9/451G06F17/3097G06F17/30705G06F17/30731G06F17/30867G06N5/025H04M1/72563H04M1/72569
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,140,384
App. No.
14/619,553
Granted
Nov 27, 2018
Kind
B2
Abstract

A method and a system for dynamically modifying at least one element of a User Interface (UI) of a first electronic device are provided. The method includes collating usage information of at least one data source in the first electronic device, categorizing the collated usage information into one or more knowledge clusters, forming a knowledge graph using the one or more knowledge clusters, and dynamically modifying the at least one element of the UI based on the knowledge graph.

Claims (80)

1. A method to dynamically modify at least one element of a user interface (UI) of a first electronic device, the method comprising:

collating usage information of at least one data source associated with a user in the first electronic device, wherein each data source is at least one item used in the first electronic device or any application running on the first electronic device;

categorizing the collated usage information into at least one knowledge cluster, wherein the categorizing includes extracting semantic content from the usage information and mapping the extracted semantic content to categorize the collated usage information into the at least one knowledge cluster using an incremental model;

storing a knowledge graph including the at least one knowledge cluster in a form of at least one knowledge node in the knowledge graph and at least one link among the at least one knowledge node; and

dynamically modifying the at least one element of the UI based on the knowledge graph,

wherein the dynamically modifying includes identifying the at least one knowledge cluster from the knowledge graph and displaying the at least one identified knowledge cluster as the at least one element of the UI.

2. The method of claim 1 , wherein the knowledge graph is stored locally in the first electronic device.

3. The method of claim 1 ,

wherein the semantic content comprises at least one of a word vector, a structure data, a topic, or a token, and

wherein the at least one knowledge cluster is incrementally updated.

4. The method of claim 3 , wherein the word vector connects extracted semantic content mapped to at least two entries in the knowledge graph.

5. The method of claim 1 , wherein the method further comprises sharing the knowledge graph of the first electronic device with a second electronic device in a knowledge-based assistive network.

6. The method of claim 1 , wherein the dynamic modifying of the at least one element of the UI based on the knowledge graph comprises:

receiving a localized query by a second electronic device from a server, the localized query comprising at least one semantic content;

computing a semantic similarity between the at least one semantic content and a knowledge graph stored in the second electronic device; and

displaying a recommendation message on the at least one element of the UI of the first electronic device based on semantic similarity, the recommendation message comprising data about the second electronic device.

7. The method of claim 1 ,

wherein the method further comprises:

monitoring the usage information of the at least one data source in the first electronic device, and

updating the at least one knowledge cluster based on the monitoring using an incremental model, and

wherein the updating comprises at least one of adding a semantic content to the at least one knowledge cluster, splitting the at least one knowledge cluster, or merging the at least one knowledge cluster.

8. The method of claim 1 , wherein the dynamic modifying of the at least one element of the UI based on the knowledge graph comprises:

displaying one or more clusters on the UI according to one or more rules; and

displaying a lower cluster or an upper cluster of the one or more clusters on the UI in response to a user's touch input.

9. The method of claim 8 , wherein the displaying of the lower cluster or the upper cluster comprises:

displaying the lower cluster on the UI when the user's touch input is a pinch zoom-out input with regard to the upper cluster; and

displaying the upper cluster on the UI when the user's touch input is a pinch zoom-in input with regard to the lower cluster.

10. The method of claim 1 , wherein each entry in the knowledge graph comprises an associated user expertise.

11. A system configured to dynamically modify at least one element of a user interface (UI) of a first electronic device, wherein the system is configured to:

collate usage information of at least one data source associated with a user in the first electronic device, wherein each data source is at least one item used in the first electronic device or any application running on the first electronic device;

categorize the collated usage information into at least one knowledge cluster, wherein the categorizing includes extracting semantic content from the usage information and mapping the extracted semantic content to categorize the collated usage information into the at least one knowledge cluster using an incremental model;

store a knowledge graph including the at least one knowledge cluster in a form of at least one knowledge node in the knowledge graph and at least one link among the at least one knowledge node; and

dynamically modify the at least one element of the UI based on the knowledge graph,

wherein the dynamically modifying includes identifying the at least one knowledge cluster from the knowledge graph and displaying the at least one identified knowledge cluster as the at least one element of the UI.

12. The system of claim 11 , wherein the knowledge graph is stored locally in the first electronic device.

13. The system of claim 11 ,

wherein the semantic content comprises at least one of a word vector, a structure data, a topic, or a token, and

wherein the at least one knowledge cluster is incrementally updated.

14. The system of claim 13 , wherein the word vector connects extracted semantic content mapped to at least two entries in the knowledge graph.

15. The system of claim 11 , wherein the system is configured to share the knowledge graph of the first electronic device with a second electronic device in a knowledge-based assistive network.

16. The system of claim 11 , wherein the system is further configured to:

receive a localized query by a second electronic device from a server, the localized query comprising at least one semantic content;

compute a semantic similarity between the at least one semantic content and a knowledge graph stored in the second electronic device; and

display a recommendation message on the at least one element of the UI of the first electronic device based on the semantic similarity, the recommendation message comprising data about the second electronic device.

17. The system of claim 11 , wherein the system is further configured to:

monitor the usage information of the at least one data source in the first electronic device; and

update the at least one knowledge cluster based on the monitoring using an incremental model, the updating comprising at least one of adding a semantic content to the at least one knowledge cluster, splitting the at least one knowledge cluster, or merging the at least one knowledge cluster.

18. The system of claim 11 , wherein each entry in the knowledge graph comprises an associated user expertise.

19. An electronic device comprising:

a communicator;

a display configured to display a user interface (UI);

a touch sensitive unit configured to receive a user's touch input; and

at least one processor configured to:

collate usage information of at least one data source associated with a user in the electronic device, wherein each data source is at least one item used in the electronic device or any application running on the electronic device,

categorize the collated usage information into at least one knowledge cluster, wherein the categorizing includes extracting semantic content from the usage information and mapping the extracted semantic content to categorize the collated usage information into the at least one knowledge cluster using an incremental model,

store a knowledge graph including the at least one knowledge cluster in a form of at least one knowledge node in the knowledge graph and at least one link among the at least one knowledge node, and

dynamically modify at least one element of the UI based on the knowledge graph,

wherein the dynamically modifying includes identifying the at least one knowledge cluster from the knowledge graph and displaying the at least one identified knowledge cluster as the at least one element of the UI.

20. The electronic device of claim 19 , wherein the knowledge graph is stored locally in the electronic device.

21. The electronic device of claim 19 ,

wherein the semantic content comprises at least one of a word vector, a structure data, a topic, or a token, and

wherein the at least one knowledge cluster is incrementally updated.

22. The electronic device of claim 19 , wherein the at least one processor is further configured to share the knowledge graph with another electronic device in a knowledge-based assistive network.

23. The electronic device of claim 19 , wherein the at least one processor is further configured to:

receive a localized query by other electronic device from a server, wherein the localized query comprises at least one semantic content,

compute a semantic similarity between the at least one semantic content and a knowledge graph stored in the other electronic device, and

display a recommendation message on at least one element of the UI of the electronic device based on semantic similarity, the recommendation message comprising data about the other electronic device.

24. The electronic device of claim 19 , wherein the at least one processor is further configured to:

monitor the usage information of the at least one data source in the electronic device, and

update the at least one knowledge cluster based on the monitoring using an incremental model.

25. The electronic device of claim 24 , wherein the at least one processor is further configured to update the at least one knowledge cluster through at least one of adding a semantic content to the at least one knowledge cluster, splitting the at least one knowledge cluster, or merging the at least one knowledge cluster.

26. The electronic device of claim 14 , wherein the at least one processor is further configured to:

display one or more clusters on the UI according to one or more rules, and

display a lower cluster or an upper cluster of the one or more clusters on the UI in response to a user's touch input.

27. The electronic device of claim 26 , wherein the at least one processor is further configured to:

display the lower cluster on the UI when the user's touch input is a pinch zoom-out input with regard to the upper cluster, and

display the upper cluster on the UI when the user's touch input is a pinch zoom-in input with regard to the lower cluster.

28. The electronic device of claim 19 , wherein the at least one knowledge node in the knowledge graph is weighted based on at least one of the user's knowledge or the user's level of knowledge.

29. The method of claim 1 , wherein the at least one knowledge node in the knowledge graph is weighted based on at least one of the user's knowledge or the user's level of knowledge.

30. The system of claim 11 , wherein the at least one knowledge node in the knowledge graph is weighted based on at least one of the user's knowledge or the user's level of knowledge.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2015
From: SATHISH, SAILESH KUMAR; NEEMA, NIRMESH; YELESWARAPU, BHAVANI SHANKAR; SINGH, SATNAM
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 034939/0339 →
Priority Claims (3)
IN 673/CHE/2014 · Feb 13, 2014 · national
IN 673/CHE/2014 · Oct 10, 2014 · national
KR 10-2015-0019445 · Feb 9, 2015 · national
Continuity (1)
Related Publication 20160103932A1 · Apr 14, 2016