Immersive augmented reality experiences using spatial audio

1. A device configured to be head mounted on a user, comprising:

a frame having a first side and a second side;

a first temple extending from a first side of the frame, the first temple having a proximal end adjacent the first side of the frame and a distal end;

a second temple extending from a second side of the frame, the second temple having a proximal end adjacent the second side of the frame and a distal end;

a processor;

a memory;

at least one image sensor;

at least four speakers that produce at least three directional audio zones, a first speaker of the at least four speakers positioned adjacent the proximal end of the first temple, a second speaker of the at least four speakers positioned adjacent the distal end of the first temple, a third speaker of the at least four speakers positioned adjacent the proximal end of the second temple, and a fourth speaker of the at least four speakers positioned adjacent the distal end of the second temple; and

programming in said memory, wherein execution of said programming by said processor configures the device to perform functions, including functions to:

capture, using the at least one image sensor, images in an environment of the device;

identify at least one of an object or feature within the captured images;

determine a position of the device within the environment with respect to the at least one object or feature;

determine a target location within the environment that may be associated with the object or feature;

determine a current orientation of the device with respect to the target location;

selectively emit audio signals from the at least one speaker in respective directional audio zones responsive to the current orientation to guide the user to the target location; and

adjust a volume of the audio signals to indicate a distance of the device from the target location.

2. The device of claim 1 , wherein the programming in said memory further comprises instructions that when executed by said processor configures the device to orient the device with respect to at least one object or feature in the environment by performing functions to:

identify a match between the at least one object or feature in the captured images and at least one stored object or feature in previously obtained information; and

determine a position of the device within the environment with respect to the at least one matched object or feature.

3. The device of claim 2 , wherein the function to determine the position of the device includes functions to:

determine a location of the device within the environment; and

determine an initial orientation of the device at the determined location.

4. The device of claim 2 , wherein the previously obtained information includes position information for location points associated with the at least one object or feature, the at least one matched object or feature includes a first matched object or feature, and wherein the function to determine the position of the device includes functions to:

identify at least two location points associated with the first matched object or feature;

determine relative position between the at least two location points associated with the first matched object or feature in the captured images and corresponding location points for the first matched object or feature in the previously obtained information; and

calculate the position of the device from the determined relative position and the position information for the corresponding location points.

5. The device of claim 2 , further comprising a wireless communication component that is operatively connected to a server system through a network, wherein said previously obtained information is stored in another memory in said server system, and wherein programming in said memory, when executed by said processor, configures the device to access said server system, retrieve said previously obtained information from said server system, and store said previously obtained information in said memory.

6. The device of claim 5 , further comprising a global positioning sensor (GPS), wherein execution of said programming by said processor configures the device to perform functions, including functions to:

receive GPS location information;

request the previously obtained information from the server system using the GPS location information, wherein the previously obtained information corresponds to the GPS location information; and

receive the requested previously obtained information corresponding to the GPS location information.

7. The device of claim 1 , wherein the at least one image sensor has a field of view, the device further comprises a display having a viewing area corresponding to the field of view, the target location is associated with a virtual object, and wherein said programming by said processor configures the device to perform additional functions, including functions to:

determine when the target location is within the field of view; and

present, on the display, the virtual object in the target location within the field of view.

8. The device of claim 7 , wherein the function to identify the target location within the environment includes functions to:

generate a random location within the environment outside the field of view; and

identify the random location as the target location.

9. The device of claim 1 , wherein the function to identify the target location within the environment includes functions to:

retrieve a location associated with the environment from said memory; and

identify the retrieved location as the target location.

10. A method for use with a device configured to be head mounted on a user, the device comprising a processor, at least one image sensor, and at least one speaker that produces at least three directional audio zones, the method comprising:

capturing, using the at least one image sensor, images in an environment of the device; identifying at least one of an object or feature within the captured images;

orienting the device with respect to at least one object or feature in the environment by identifying a match between the at least one object or feature in the captured images and at least one stored object or feature in previously obtained information including position information for location points associated with the objects or features,

determining a position of the device within the environment with respect to a first matched object or feature by identifying at least two location points associated with the first matched object or feature, determining a relative position between the at least two location points associated with the first matched object or feature in the captured images and corresponding location points for the first matched object or feature in the previously obtained obtaining information, and calculating the position of the device from the determined relative position and the position information for the corresponding location points;

determining a target location within the environment that may be associated with the object or feature;

determining a current orientation of the device with respect to the target location;

selectively emitting audio signals from the at least one speaker in respective directional audio zones responsive to the current orientation to guide the user to the target location; and

adjusting a volume of the audio signals to indicate a distance of the device from the target location.

11. The method of claim 10 , wherein the determining the position of the device comprises:

determining a location of the device within the environment; and

determining an initial orientation of the device at the determined location.

12. The method of claim 10 , wherein the at least one image sensor has a field of view, the device further comprises a display having a viewing area corresponding to the field of view, the target location is associated with a virtual object, and wherein the method further comprises:

determining when the target location is within the field of view; and

presenting, on the display, the virtual object in the target location within the field of view.

13. The method of claim 12 , wherein the identifying the target location within the environment comprises:

generating a random location within the environment outside the field of view; and

identifying the random location as the target location.

14. The method of claim 10 , wherein the identifying the target location within the environment comprises:

retrieving a location associated with the environment from memory; and

identifying the retrieved location as the target location.

15. The method of claim 10 , wherein the device further comprises wireless communication component that is operatively connected to a server system through a network, the server system storing said previously obtained information, and wherein the method further comprises:

retrieving said previously obtained information from said server system; and

storing said previously obtained information in a memory.

16. The method of claim 15 , wherein the device further comprises a global positioning sensor (GPS) and wherein the method further comprises:

receiving GPS location information;

requesting the previously obtained information from the server system using the GPS location information, wherein the previously obtained information corresponds to the GPS location information; and

receiving the requested previously obtained information corresponding to the GPS location information.

17. A non-transitory computer-readable medium storing program code for use with a device configured to be head mounted on a user, the device comprising a processor, at least one image sensor, and at least one speaker that produces at least three directional audio zones, the program code, when executed, is operative to cause the processor to:

capture, using the at least one image sensor, images in an environment of the device;

identify at least one of an object or feature within the captured images;

determine a position of the device within the environment with respect to the at least one object or feature;

orient the device with respect to the at least one object or feature by retrieving previously obtained information from a remote server system, storing the previously obtained information in a memory of the device, identifying a match between the at least one object or feature in the captured images and at least one stored object or feature in the previously obtained information, and determining a position of the device within the environment with respect to the at least one matched object or feature;

determine a target location within the environment that may be associated with the object or feature;

determine a current orientation of the device with respect to the target location;

selectively emit audio signals from the at least one speaker in respective directional audio zones responsive to the current orientation to guide the user to the target location; and

adjust a volume of the audio signals to indicate a distance of the device from the target location.

18. The non-transitory computer-readable medium of claim 17 , wherein the program code further includes program code operative to cause the processor to:

receive GPS location information;

request the previously obtained information from the server system using the GPS location information, wherein the previously obtained information corresponds to the GPS location information; and

receive the requested previously obtained information corresponding to the GPS location information.

19. The non-transitory computer-readable medium of claim 17 , wherein the previously obtained information includes position information for location points associated with the at least one object or feature, the at least one matched object or feature includes a first matched object or feature, and wherein the program code further includes program code operative to cause the processor to determine the position of the device by performing operations to:

identify at least two location points associated with the first matched object or feature;

determine relative position between the at least two location points associated with the first matched object or feature in the captured images and corresponding location points for the first matched object or feature in the previously obtained information; and

calculate the position of the device from the determined relative position and the position information for the corresponding location points.