Methods and systems for interacting with digital objects using a gaze tracking-enabled headset
A method of interacting with digital objects in a database associated with physical objects in an external environment includes tracking, by a camera on the headset, a gaze of a user in the external environment. identifying a gaze condition in response to determining the gaze of the user is directed to a physical object of interest in the external environment for at least a predetermined dwell-time, receiving a user input associated with the headset, and activating a digital interaction in response to identifying the gaze condition and receiving the user input, wherein the digital interaction relates to the physical object of interest in the database. Systems for performing the method may include a head mounted frame including a headset camera and a microphone as well as a processing unit. A unit for communicating with other computing resources may also be included.
1. A method for a device to interact with digital objects in a database associated with physical objects in an external environment, the method comprising:
tracking, by a camera on a headset, a gaze of a user in the external environment;
identifying a first gaze condition in response to determining the gaze of the user is directed to a first physical object of interest in the external environment for at least a first predetermined dwell time;
receiving a first user input associated with the headset;
activating a first digital interaction in response to said identifying the first gaze condition and said receiving the first user input, wherein the first digital interaction relates to the first physical object of interest;
creating a first digital object in the database, wherein the first digital object is associated with the first physical object of interest;
identifying a second gaze condition in response to determining the gaze of the user is directed to the first physical object of interest for at least a second predetermined dwell time;
receiving a second user input associated with the headset, wherein the second user input is for modifying the first digital object; and
modifying the first digital object in response to identifying the second gaze condition and receiving the second user input.
2. The method of claim 1 , wherein the first user input is a first voice command from a microphone and/or the second user input is a second voice command from the microphone.
3. The method of claim 1 , further comprising:
receiving a modifying instruction from a digital object management system; and
modifying a digital object in the database.
4. The method of claim 1 , wherein the first digital object is read only.
5. The method of claim 1 ,
wherein the first user input is a first query input; and
wherein the first digital interaction is at least one of:
a query of the presence of a digital object relating to the first physical object of interest,
a query of information relating to a digital object relating to the first physical object of interest, and
information about the first physical object of interest.
6. The method of claim 1 , further comprising:
identifying a first detection condition in response to the first object of interest having a related digital object; and
generating a user notification in response to identifying the first gaze condition and the first detection condition.
7. The method of claim 6 , wherein the user notification is a vibrotactile.
8. The method of claim 6 , wherein the user notification is an auditory.
9. The method of claim 6 , wherein the user notification is one of light, light emitting diode (LED), LED array, and audio.
10. The method of claim 1 , wherein at least one of the first user input or the second user input is from a touch enabled secondary smart device associated with the headset.
11. The method of claim 10 , wherein the first user input includes a selection of a digital object displayed on the secondary smart device and associated with the first digital object.
12. The method of claim 1 , wherein the first user input is a stored user input.
13. The method of claim 1 , wherein the first digital interaction is in another database and the database is accessible by other devices.
14. One or more non-transitory computer-readable storage media comprising computer-executable instructions, wherein the instructions, when executed, cause a processing structure to perform the method of claim 1 .
15. A system for interacting with digital objects in a database associated with physical objects in an external environment, the system comprising:
a head mounted frame comprising:
a headset camera comprising a gaze tracker;
a microphone configured to receive a first user input; and
a processing unit coupled to the frame and configured to control the headset camera and the microphone to:
track a gaze of a user in the external environment;
identify a first gaze condition in response to determining the gaze of the user is directed to a first physical object of interest in the external environment for at least a first predetermined dwell time;
receive a first user input;
activate a first digital interaction in response to the identified first gaze condition and the received first user input, wherein the first digital interaction relates to the first physical object of interest;
create a first digital object in the database, wherein the first digital object is associated with the first physical object of interest;
identify a second gaze condition in response to determining the gaze of the user is directed to the first physical object of interest for at least a second predetermined dwell time;
receive a second user input associated with the headset, wherein the second user input is for modifying the first digital object; and
modify the first digital object in response to identifying the second gaze condition and receiving the second user input.
16. The system of claim 15 , wherein the head mounted frame further comprises one or more of a vibrotactile module for generating vibrational output, a speaker, a LED, and an LED array.
17. The system of claim 15 , wherein the head mounted frame and the processing unit are coupled with one or more of: universal serial bus, Thunderbolt™, WiFi™, Bluetooth, and direct wireless.
18. A head mounted frame interacting with digital objects in a database associated with physical objects in an external environment, the frame comprising:
a camera configured to obtain images relating to a gaze of a user in the external environment;
a microphone; and
a processing structure configured to:
track the gaze of a user from the images;
identify a first gaze condition in response to determining the gaze of the user is directed to a first physical object of interest in the external environment for at least a first predetermined dwell time;
receive a first voice input from the microphone; and
activate a first digital interaction in response to identifying the first gaze condition and receiving the first voice input, wherein the first digital interaction relates to the first physical object of interest;
create a first digital object in the database, wherein the first digital object is associated with the first physical object of interest; and
identify a second gaze condition in response to determining the gaze of the user is directed to the first physical object of interest for at least a second predetermined dwell time;
receive a second user input associated with the headset, wherein the second user input is for modifying the first digital object; and
modify the first digital object in response to identifying the second gaze condition and receiving the second user input.
19. The frame of claim 18 further comprising one or more of a vibrotactile module configured to generate vibrational output, a speaker, an LED, and an LED array.
20. The frame of claim 18 , wherein the processing structure further comprises a communications subsystem for communicating with other computing systems.