Visualization and augmentation of human knowledge construction during material consumption
View Patent ↗Providing knowledge representation of material content being consumed by a user combines the user's current behavioral data and data from external sources such as internet web sites and social media network. Visual representations of entities and their relationships in the content being consumed by the user are created while the user is consuming content, and displayed via a graphical user interface.
1. A system comprising:
a hardware processor;
a memory device coupled with the hardware processor;
the hardware processor configured to at least:
analyze content of material presented to a user for user consumption;
generate entities and relationships between the entities specified in the content of material;
detect the user's behavior during the consuming of the content of the material, the detected user's behavior including at least speed at which the user is consuming the material;
generate weights to assign to the entities and relationships, and based on the user's behavior including at least the speed at which the user is consuming the material, updating the weights, the weights updated further based on the user's previous knowledge of the entities;
search at least websites and social media databases to determine relevancy of the entities and relationships to the user;
based on the relevancy, update the weights;
generate a visualization that displays based on the weights, the entities as nodes and the relationships as edges between the nodes, the visualization changing over time based on the updating of the weights,
wherein different states of the visualization based on different times selected can be visualized.
2. The system of claim 1 , wherein the content of the material comprises at least one of text, image and a video.
3. The system of claim 1 , wherein the hardware processor is coupled with at least one of a digital glass, an electronic-book device, and a smart television.
4. The system of claim 1 , wherein the weights are incremented based on a frequency of occurrence of the entities and relationships in the content being consumed.
5. The system of claim 1 , wherein the weights are incremented based on an amount of user attention paid to the entities and relationships detected based on the user's behavior.
6. The system of claim 1 , wherein the weights are incremented based on the user's previous knowledge of the entities and relationships, the user's previous knowledge determined from the searching of the at least websites and social media databases.
7. The system of claim 1 , wherein the weights are incremented based on a current exposition of the entities and relationship determined from the searching of the at least websites and social media databases.
8. A computer-implemented method comprising:
analyzing content of material presented to a user for user consumption;
generating entities and relationships between the entities specified in the content of material;
detecting the user's behavior during the consuming of the content of the material, the detected user's behavior including at least speed at which the user is consuming the material;
generating weights to assign to the entities and relationships and based on the user's behavior including at least the speed at which the user is consuming the material, updating the weights, the weights updated further based on the user's previous knowledge of the entities;
searching at least websites and social media databases to determine relevancy of the entities and relationships to the user;
based on the relevancy, updating the weights;
generating a visualization that displays based on the weights, the entities as nodes and the relationships as edges between the nodes, the visualization changing over time based on the updating of the weights,
wherein different states of the visualization based on different times selected can be visualized.
9. The method of claim 8 , wherein the content of the material comprises at least one of text, image and a video.
10. The method of claim 8 , wherein the method is performed using a device comprising at least one of a digital glass, an electronic-book device, and a smart television.
11. The method of claim 8 , wherein the weights are incremented based on a frequency of occurrence of the entities and relationships in the content being consumed.
12. The method of claim 8 , wherein the weights are incremented based on an amount of user attention paid to the entities and relationships detected based on the user's behavior.
13. The method of claim 8 , wherein the weights are incremented based on the user's previous knowledge of the entities and relationships, the user's previous knowledge determined from the searching of the at least websites and social media databases.
14. The method of claim 8 , wherein the weights are incremented based on a current exposition of the entities and relationship determined from the searching of the at least websites and social media databases.
15. A computer program product comprising a noon-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to:
analyze content of material presented to a user for user consumption;
generate entities and relationships between the entities specified in the content of material;
detect the user's behavior during the consuming of the content of the material, the detected user's behavior including at least speed at which the user is consuming the material;
generate weights to assign to the entities and relationships and based on the user's behavior including at least the speed at which the user is consuming the material, updating the weights, the weights updated further based on the user's previous knowledge of the entities;
search at least websites and social media databases to determine relevancy of the entities and relationships to the user;
based on the relevancy, update the weights;
generate a visualization that displays based on the weights, the entities as nodes and the relationships as edges between the nodes, the visualization changing over time based on the updating of the weights,
wherein different states of the visualization based on different times selected can be visualized.
16. The computer program product of claim 15 , wherein the content of the material comprises at least one of text, image and a video.
17. The computer program product of claim 15 , wherein the device is associated with at least one of a digital glass, an electronic-book device, and a smart television.
18. The computer program product of claim 15 , wherein the weights are incremented based on a frequency of occurrence of the entities and relationships in the content being consumed.
19. The computer program product of claim 15 , wherein the weights are incremented based on an amount of user attention paid to the entities and relationships detected based on the user's behavior.
20. The computer program product of claim 15 , wherein the weights are incremented based on the user's previous knowledge of the entities and relationships, the user's previous knowledge determined from the searching of the at least websites and social media databases, and wherein the further weights are adjusted based on a current exposition of the entities and relationship determined from the searching of the at least websites and social media databases.