Augmented reality with eyewear triggered IoT

1. A system comprising:

a device configured to be head mounted on a user, the device comprising;

a processor, a memory, a display, a transceiver, and at least one image sensor;

programming in said memory, wherein execution of said programming by said processor configures the device to perform functions, including functions to:

capture, with the at least one image sensor, image information of an environment surrounding the device;

identify a match between at least one object in the image information and at least one stored object in previously obtained information;

determine a position of the device within the environment with respect to the at least one matched object;

establish, via the transceiver, communication with a remote device in response to the position of the device reaching a predetermined location within the environment, the remote device configured to produce a physical output; and

control the remote device to vary the physical output as the position of the device changes within the environment.

2. The system of claim 1 , wherein the function to determine the position of the device includes functions to:

determine a location of the device within the environment; and

determine an orientation of the device at the determined location.

3. The system of claim 2 , wherein the device establishes communication with the remote device responsive to the determined location matching the predetermined location and wherein the device controls the remote device responsive to the location and the orientation.

4. The system of claim 1 , wherein the previously obtained information includes position information for location points associated with the objects, the at least one matched object includes a first matched object, and wherein the function to determine the position of the device includes functions to:

identify at least two location points associated with the first matched object;

determine relative position between the at least two location points associated with the first matched object in the image information and corresponding location points for the first matched object in the previously obtaining information; and

calculate the position of the device from the determined relative position and the position information for the corresponding location points.

5. The system of claim 1 , wherein execution of said programming includes providing, when the position of the device reaches the predetermined location within the environment, a signal to said remote device; and wherein, upon receipt of said signal, the physical output is produced.

6. The system of claim 1 , wherein identifying a match between objects in the information depicting the environment surrounding the device and objects in previously obtained information comprises identifying a match between a feature in the information depicting the environment surrounding the device and a predetermined feature in the previously obtained information.

7. The system of claim 6 , wherein the predetermined feature has been tagged with a geolocation marker.

8. The system of claim 1 , wherein said previously obtained information is stored in said memory.

9. The system of claim 1 , wherein said device also comprises a wireless communication component; wherein said system is operatively connected to a server system through a network; wherein said previously obtained information is stored in another memory in said server system; and wherein programming in said memory, when executed by said processor configures the device to access said server system; retrieve said previously obtained information from said server system, and store said previously obtained information in said memory.

10. The system of claim 1 , wherein the function to establish communication when the position of the device reaches the predetermined location includes functions to:

determine, using said device, a position of said device with respect to objects obtained from the match;

construct, using said device, a map of the environment surrounding said device and determine said device's location within the environment; and

determine, using said device, a head pose of said device within the environment.

11. The system of claim 1 , the device further comprising a global positioning sensor (GPS) and wherein execution of said programming by said processor configures the device to perform functions, including functions to:

receive GPS location information;

request the previously obtained information from a server system using the GPS location information, wherein the previously obtained information corresponds to the GPS location information; and

receive the requested previously obtained information corresponding to the GPS location information.

12. A method for use with a device configured to be head mounted on a user, the device comprising a processor, a memory, a display, a transceiver, and at least one image sensor, the method comprising:

capturing, with the at least one image sensor, image information of an environment surrounding the device;

identifying a match between at least one object in the image information and at least one stored object in previously obtained information;

determining a position of the device within the environment with respect to the at least one matched object;

establishing, via the transceiver, communication with a remote device in response to the position of the device reaching a predetermined location within the environment, the remote device configured to produce a physical output; and

controlling the remote device to vary the physical output as the position of the device changes within the environment.

13. The method of claim 12 , wherein the determining the position of the device includes functions to:

determining a location of the device within the environment; and

determining an orientation of the device at the determined location.

14. The method of claim 12 , wherein the previously obtained information includes position information for location points associated with the objects, the at least one matched object includes a first matched object, and wherein the determining the position of the device includes the steps of:

identifying at least two location points associated with the first matched object;

determining relative position between the at least two location points associated with the first matched object in the image information and corresponding location points for the first matched object in the previously obtaining information; and

calculating the position of the device from the determined relative position and the position information for the corresponding location points.

15. The method of claim 12 , further comprising providing, when the position of the device reaches the predetermined location within the environment, a signal to said remote device; and wherein, upon receipt of said signal, the physical output is produced.

16. The method of claim 12 , wherein the identifying a match between objects in the information depicting the environment surrounding the device and objects in previously obtained information comprises identifying a match between a feature in the information depicting the environment surrounding the device and a predetermined feature in the previously obtained information.

17. The method of claim 12 , wherein the establishing communication when the position of the device reaches the predetermined location includes:

determining, using said device, a position of said device with respect to objects obtained from the match;

constructing, using said device, a map of the environment surrounding said device and determining said device's location within the environment; and

determining, using said device, a head pose of said device within the environment.

18. The method of claim 12 , the device further comprising a global positioning sensor (GPS) and wherein the method further comprises:

receiving GPS location information;

requesting the previously obtained information from a server system using the GPS location information, wherein the previously obtained information corresponds to the GPS location information; and

receiving the requested previously obtained information corresponding to the GPS location information.

19. A non-transitory computer-readable medium storing program code for use with a device configured to be head mounted on a user, the device comprising a processor, a memory, a display, a transceiver, and at least one image sensor, the program code, when executed, is operative to cause an electronic processor to:

capture, with the at least one image sensor, image information of an environment surrounding the device;

identify a match between at least one object in the image information and at least one stored object in previously obtained information;

determine a position of the device within the environment with respect to the at least one matched object;

establish, via the transceiver, communication with a remote device in response to the position of the device reaching a predetermined location within the environment, the remote device configured to produce a physical output; and

control the remote device to vary the physical output as the position of the device changes within the environment.

20. The non-transitory computer-readable medium of claim 19 , wherein to determine the position of the device the program code, when executed, is operative to further cause the electronic processor to:

determine a location of the device within the environment; and

determine an orientation of the device at the determined location.