Manipulation of virtual object in augmented reality via thought
A system and method for manipulating a virtual object based on thought is described. A reference identifier from a physical object is captured. Brain activity data of a user is received to obtain a brain activity data. The reference identifier and the brain activity data are communicated via a network to a remote server. The remote server selects a virtual object based on the reference identifier and the brain activity data. A communication from the server identifying the virtual object is received. The virtual object is displayed in a virtual landscape.
1. A device comprising:
an electroencephalography (EEG) brain wave sensor coupled to a user of the device to generate brain wave data;
a heart rate sensor to generate heart rate data of the user;
a location sensor to determine a geographic location of the device;
a camera configured to capture a reference identifier from a physical object;
a display configured to display a first virtual object based on the reference identifier;
an eye tracking sensor to determine a gaze of the user on the display; and
a virtual object generation module, implemented using at least one hardware processor, configured to:
receive brain activity data of a user of the device, the brain activity data generated in response to displaying the first virtual object in the display;
communicate the reference identifier and the brain activity data via a network to a remote server, the remote server configured to identify a plurality of virtual objects associated with the reference identifier, to retrieve a plurality of brainwave patterns based on the plurality of virtual objects, each brainwave pattern associated with a corresponding virtual object, to compare the brain activity data of the user with the plurality of brainwave patterns, and to identify a second virtual object from the plurality of virtual objects, the second virtual object associated with a brainwave pattern from the plurality of brainwave patterns, the brainwave pattern corresponding to the brain activity data;
receive a communication from the server identifying the second virtual object;
display the second virtual object with the first virtual object in the display; and
adjust a view of the first and second virtual object in the display based on a position of the device relative to the physical object, and
an electric wave application configured to identify a state of mind of the user based on the brain wave data, heart rate data, the geographic location of the device, and the gaze of the user.
2. The device of claim 1 , further comprising:
a storage device configured to store a plurality of virtual object models with corresponding reference identifiers,
wherein the virtual object generation module is configured to determine whether the reference identifier corresponds to any reference identifiers stored in the storage device, to access a virtual object model corresponding to the reference identifier from the storage device, and to generate the virtual object using the virtual object model.
3. The device of claim 1 , wherein the virtual object generation module is configured to receive a virtual object model corresponding to the reference identifier from the remote server, and to generate the virtual object using the virtual object model.
4. The device of claim 1 , further comprising:
a social network module configured to access social network information associated with the user,
wherein the electric wave application further identifies the state of mind of the user based the social network information associated with the user.
5. The device of claim 1 , further comprising:
a visual gesture module configured to determine a focus area in a display of the virtual landscape and a feature of the virtual object, and to change the state of the feature of the virtual object in the focus area in response to a change in the brain activity data of the user.
6. The device of claim 5 , further comprising:
a storage device coupled to the processor, the storage device comprising a database configured to store visual references, virtual objects associated with a combination of a visual reference and corresponding intensity and patterns of electric waves from the user, and features of the virtual objects, the features of the virtual objects being configured to change state in response to a change in the intensity and patterns of electric waves of the user.
7. The device of claim 5 , wherein the focus area corresponds to a predefined portion of the display, wherein the state of the feature changes in response to the feature being located within the predefined portion of the display, wherein the predefined portion of the display comprises at least one of an area central to the display, an area adjacent to an edge of the display, an area adjacent to a corner of the display, or a user-defined portion of a display area.
8. The device of claim 7 , wherein the state of the feature changes in response to the feature being located within the predefined portion of the display for a time duration exceeding a time threshold.
9. The device of claim 5 , wherein the visual gesture module comprises a focus area detector and a feature state modifier,
the focus area detector configured to detect a presence of the feature of the three-dimensional virtual object in the focus area of the display; and
the feature state modifier configured to change a state of the feature in response to the feature being present in the focus area.
10. The device of claim 9 , wherein the feature state modifier is configured to change the state of the feature by replacing a first component of the virtual object in the focus area with a second component of the virtual object in the focus area.
11. A method comprising:
using a computing device, capturing a reference identifier from a physical object;
displaying a first virtual object in a display of the computing device, the first virtual object based on the reference identifier;
receiving brain activity data of a user of the computing device, the brain activity data generated in response displaying the first virtual object in the display of the computing device;
communicating the reference identifier and the brain activity data via a network to a remote server, the remote server configured to identify a plurality of virtual objects associated with the reference identifier, to retrieve a plurality of brainwave patterns based on the plurality of virtual objects, each brainwave pattern associated with a corresponding virtual object, to compare the brain activity data of the user with the plurality of brainwave patterns, and to identify a second virtual object from the plurality of virtual objects, the second virtual object associated with a brainwave pattern from the plurality of brainwave patterns, the brainwave pattern corresponding to the brain activity data;
receiving a communication from the server identifying the second virtual object;
displaying the second virtual object with the first virtual object in the display;
adjusting a view of the first and second virtual object in the display based on a position of the device relative to the physical object;
generating brain wave data using an electroencephalography (EEG) brain wave sensor coupled to the user;
generating heart rate data of the user using a heart rate sensor;
determining a gaze of the user on the display using an eye tracking sensor;
determining a geographic location of the computing device; and
identifying a state of mind of the user based on the brain wave data, the heart rate data, the gaze of the user, and the geographic location of the computing device.
12. The method of claim 11 , further comprising:
storing a plurality of virtual object models with corresponding reference identifiers in a storage device of the computing device;
determining whether the reference identifier corresponds to any reference identifiers stored in the storage device;
accessing a virtual object model corresponding to the reference identifier from the storage device; and
generating the virtual object using the virtual object model.
13. The method of claim 11 , further comprising:
receiving a virtual object model corresponding to the reference identifier from the remote server; and
generating the virtual object using the virtual object model.
14. The method of claim 11 , further comprising:
accessing social network information associated with the user; and
identifying the state of mind of the user based on the social network information associated with the user.
15. The method of claim 11 , further comprising:
determining a focus area in the display and a feature of the virtual object; and
changing the state of the feature of the virtual object in response to the feature being in the focus area of the display or a change in the brain activity data of the user.
16. The method of claim 13 , further comprising:
storing in a database, visual references, virtual objects associated with a combination of a visual reference and corresponding intensity and patterns of electric waves from the user, and features of the virtual objects, the features of the virtual objects being configured to change state in response to a change in the brain activity data of the user.
17. The method of claim 13 , wherein the focus area corresponds to a predefined portion of the display, wherein the state of the feature changes in response to the feature being located within the predefined portion of the display, wherein the predefined portion of the display comprises at least one of an area central to the display, an area adjacent to an edge of the display, an area adjacent to a corner of the display, or a user-defined portion of a display area.
18. The method of claim 16 , further comprising:
changing the state of the feature in response to the feature being located within the predefined portion of the display for a time duration exceeding a time threshold.
19. The method of claim 13 , further comprising:
detecting a presence of the feature of the virtual object in the focus area of the display; and
changing a state of the feature in response to the feature being present in the focus area.
20. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
capturing a reference identifier from a physical object;
displaying a first virtual object in a display of the computing device, the first virtual object based on the reference identifier;
receiving brain activity data of a user of the computing device, the brain activity data generated in response displaying the first virtual object in the display of the computing device;
communicating the reference identifier and the brain activity data via a network to a remote server, the remote server configured to identify a plurality of virtual objects associated with the reference identifier, to retrieve a plurality of brainwave patterns based on the plurality of virtual objects, each brainwave pattern associated with a corresponding virtual object, to compare the brain activity data of the user with the plurality of brainwave patterns, and to identify a second virtual object from the plurality of virtual objects, the second virtual object associated with a brainwave pattern from the plurality of brainwave patterns, the brainwave pattern corresponding to the brain activity data;
receiving a communication from the server identifying the second virtual object;
displaying the second virtual object with the first virtual object in the display;
adjusting a view of the first and second virtual object in the display based on a position of the device relative to the physical object;
generating brain wave data using an electroencephalography (EEG) brain wave sensor coupled to the user;
generating heart rate data of the user using a heart rate sensor;
determining a gaze of the user on the display using an eye tracking sensor;
determining a geographic location of the computing device; and
identifying a state of mind of the user based on the brain wave data, the heart rate data, the gaze of the user, and the geographic location of the computing device.