METHOD AND SYSTEM FOR RETRIEVING DATA IN RESPONSE TO USER ACTIVITY
A waveguide apparatus includes a planar waveguide and at least one optical diffraction element (DOE) that provides a plurality of optical paths between an exterior and interior of the planar waveguide. A phase profile of the DOE may combine a linear diffraction grating with a circular lens, to shape a wave front and produce beams with desired focus. Waveguide apparati may be assembled to create multiple focal planes. The DOE may have a low diffraction efficiency, and planar waveguides may be transparent when viewed normally, allowing passage of light from an ambient environment (e.g., real world) useful in AR systems. Light may be returned for temporally sequentially passes through the planar waveguide. The DOE(s) may be fixed or may have dynamically adjustable characteristics. An optical coupler system may couple images to the waveguide apparatus from a projector, for instance a biaxially scanning cantilevered optical fiber tip.
1 . A method of retrieving data, comprising:
receive data corresponding to a real-world activity of a user;
identifying the real-world activity based on the received data;
retrieving a knowledge base associated with the real-world activity;
identifying information in the knowledge base relevant to the real-world activity;
creating a virtual user interface in a field of view of the user; and
displaying the identified relevant information on the virtual user interface, while the user is engaged in the real-world activity.
2 . The method of claim 1 , wherein the data is selected from the group consisting of visual, audio, and sensory data.
3 . The method of claim 1 , further comprising:
receiving a user input; and
identifying information in the knowledge base relevant to the real-world activity based on the user input.
4 . The method of claim 3 , wherein the user input is selected from the group consisting of visual, audio, and sensory input.
5 . The method of claim 3 , further comprising:
identifying a specific real-world activity based on the user input, wherein the specific real-world activity is a subset of the real-world activity; and
identifying information in the knowledge base relevant to the specific real-world activity.
6 . The method of claim 5 , wherein the data is an image of the user cutting vegetables,
wherein the real-world activity is cooking,
wherein the specific activity is cooking a particular recipe, and
wherein the relevant information corresponds to the particular recipe.
7 . The method of claim 1 , wherein the data is an image of the user cutting vegetables, and wherein the real-world activity is cooking.
8 . The method of claim 7 , wherein the relevant information corresponds to a particular recipe.
9 . The method of claim 1 , wherein the knowledge base is retrieved from a networked memory.
10 . The method of claim 1 , further comprising:
receiving user feedback to the displayed relevant information; and
performing an action based on the received user feedback.
11 . The method of claim 1 implemented as a system having means for implementing the method steps.
12 . The method of claim 1 implemented as a computer program product comprising a computer-usable storage medium having executable code to execute the method steps.