Navigating an electronic document by visual object elements
View Patent ↗An education digital reading platform provides a visualization interface displaying visual object elements of a document to a user. A visual object element may include images, videos, charts, tables, etc. The visual objects may be identified in a document by extracting metadata associated with the document. Additionally, the ideas or concepts represented by the visual object elements may be identified by analyzing the document, and content related to the ideas or concepts may be identified and associated with the visual object elements. The related content may include user generated content or content stored in one or more databases. The related content is provided to a user in the visualization interface wherein the user may access the related content. The interface allows a user to navigate a document by moving from one visual object element to another.
1. A method for navigating an educational electronic document by visual object elements, the method comprising:
identifying a plurality of visual object elements within the educational electronic document by deconstructing the document, wherein deconstructing the document comprises determining a structure of the educational electronic document specifying a page of the educational electronic document associated with each visual object element;
sending a first page of the educational electronic document for display to a user by an eReading browser application, the first page having a visual object element and one or more textual regions;
responsive to a first user input received at the eReading browser application, sending for presentation to the user, a visualization interface displaying a first visual object element associated with the first page of the educational electronic document and not displaying the one or more textual regions of the first page, the visualization interface displayed by the eReading browser application; and
responsive to a second user input received at the visualization interface, navigating to a second visual object element of the educational electronic document according to the determined structure of the document, the second visual object element associated with a second page having one or more textual regions, wherein navigating comprises:
sending the second visual object element for display in the visualization interface and not displaying the one or more textual regions of the second page.
2. The method of claim 1 , wherein a visual object element is identified by at least one of its size, shape, color and location within a document.
3. The method of claim 1 , wherein visual object elements comprise at least one of an image, a video, a graph, a formula, a special character and a table.
4. The method of claim 1 :
wherein determining the structure of the educational electronic document comprises accessing a table of contents associated with the educational electronic document, the table of contents specifying an ordering of the visual object elements in the document; and
wherein navigating according to the determined structure of the document comprises navigating to a next visual object element in the ordering specified by the table of contents.
5. The method of claim 1 , wherein the educational electronic document is a textbook.
6. The method of claim 1 , wherein each visual object element is associated with a caption describing the visual object element, the method further comprising:
identifying content of the educational electronic document respectively related to each of the plurality of visual object elements, the related content semantically related to a corresponding visual object element or the caption describing the visual object element; and
responsive to receiving a third user input, sending the related content for display in the visualization interface.
7. The method of claim 6 , further comprising:
identifying at least one concept represented by the visual object element; and
identifying the content related to a corresponding visual object element based on the identified concept.
8. The method of claim 6 , wherein identifying the related content comprises searching for the related content in a textbook addendum.
9. The method of claim 6 , wherein the content of the educational electronic document related to each visual object element is a paragraph of the document.
10. The method of claim 6 , wherein the content of the educational electronic document related to each visual object element is a page of the document.
11. The method of claim 6 , wherein the visualization interface is configured to display the content related to the first visual object element adjacent to the first visual object element.
12. A non-transitory computer-readable storage medium storing executable computer program instructions for navigating an educational electronic document by visual object elements, the computer program instructions comprising instructions for:
identifying a plurality of visual object elements within the educational electronic document by deconstructing the document, wherein deconstructing the document comprises determining a structure of the educational electronic document specifying a page of the educational electronic document associated with each visual object element;
sending a first page of the educational electronic document for display to a user by an eReading browser application, the first page having a visual object element and one or more textual regions;
responsive to a first user input received at the eReading browser application, sending for presentation to the user, a visualization interface displaying a first visual object element associated with the first page of the educational electronic document and not displaying the one or more textual regions of the first page, the visualization interface displayed by the eReading browser application; and
responsive to a second user input received at the visualization interface, navigating to a second visual object element of the educational electronic document according to the determined structure of the document, the second visual object element associated with a second page having one or more textual regions, wherein navigating comprises:
sending the second visual object element for display in the visualization interface and not displaying the one or more textual regions of the second page.
13. The non-transitory computer-readable medium of claim 12 , wherein a visual object element is identified by at least one of its size, shape, color and location within a document.
14. The non-transitory computer-readable medium of claim 12 , wherein visual object elements comprise at least one of an image, a video, a graph, a formula, a special character and a table.
15. The non-transitory computer-readable medium of claim 12 :
wherein determining the structure of the educational electronic document comprises accessing a table of contents associated with the educational electronic document, the table of contents specifying an ordering of the visual object elements in the document; and
wherein navigating according to the determined structure of the document comprises navigating to a next visual object element in the ordering specified by the table of contents.
16. The non-transitory computer-readable medium of claim 12 , wherein the educational electronic document is a textbook.
17. The non-transitory computer readable medium of claim 12 , wherein each visual object element is associated with a caption describing the visual object element, further comprising instructions for:
identifying content of the educational electronic document respectively related to each of the plurality of visual object elements, the related content semantically related to a corresponding visual object element or the caption describing the visual object element; and
responsive to receiving a third user input, sending the related content for display in the visualization interface.
18. The non-transitory computer-readable medium of claim 17 , further comprising instructions for:
identifying at least one concept represented by the visual object element; and
identifying the content related to a corresponding visual object element based on the identified concept.
19. The non-transitory computer-readable medium of claim 17 , wherein identifying the related content comprises searching for the related content in a textbook addendum.
20. The non-transitory computer-readable medium of claim 17 , wherein the content of the educational electronic document related to each visual object element is a paragraph of the document.
21. The non-transitory computer-readable medium of claim 17 , wherein the content of the educational electronic document related to each visual object element is a page of the document.
22. The non-transitory computer-readable medium of claim 17 , wherein the visualization interface is configured to display the content related to the first visual object element adjacent to the first visual object element.