AR GLASSES WITH PREDICTIVE CONTROL OF EXTERNAL DEVICE BASED ON EVENT INPUT

1 . A system, comprising:

a head-mounted display device including an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable, a camera configured to image the surrounding environment, and an image source configured to introduce content for display via the optical assembly;

a processor; and

a storage device comprising instructions executable by the processor to

sense a hand gesture, and

control a cursor displayed by the head-mounted display device based on the hand gesture.

2 . The system of claim 1 , further comprising a peripheral hand motion sensing device configured to sense the hand gesture.

3 . The system of claim 2 , wherein the peripheral hand motion sensing device comprises an inertial sensor.

4 . The system of claim 2 , wherein the peripheral hand motion sensing device comprises one or more of a pen, a wrap, a ring, a pad, and a glove.

5 . The system of claim 1 , wherein the instructions are executable to sense the hand gesture via the camera of the head-mounted display device.

6 . The system of claim 1 , wherein the instructions are executable to detect one or more of a letter, a word, and a symbol indicated by the hand gesture, and to command the head-mounted display device based upon the one or more of the letter, the word, and the symbol.

7 . The system of claim 1 , wherein the instructions are executable to move the cursor within the surrounding environment in three dimensions based upon motion of the hand gesture.

8 . The system of claim 1 , wherein the instructions are executable to sense the hand gesture performed by a first hand, sense a second hand gesture performed by a second hand, and control a first cursor and a second cursor based upon the first hand gesture and the second hand gesture.

9 . A system, comprising:

a head-mounted display device including an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable, a camera configured to image the surrounding environment, and an image source configured to introduce content for display via the optical assembly; and

a peripheral hand motion sensing device configured to provide input to the head-mounted display device, the peripheral hand motion sensing device comprising one or more motion sensors configured to sense motion data of a gesture performed by a hand holding the peripheral hand motion sensing device and send the motion data to the head-mounted display device.

10 . The system of claim 9 , wherein the head-mounted display device is configured to display a cursor and to control the cursor based on the motion data received from the peripheral hand motion sensing device.

11 . The system of claim 10 , wherein the instructions are executable to control movement of the cursor in three dimensions.

12 . The system of claim 9 , wherein the peripheral hand motion sensing device comprises an inertial sensor.

13 . The system of claim 9 , wherein the peripheral hand motion sensing device comprises one or more of a pen, a wrap, a ring, a pad, and a glove.

14 . The system of claim 9 , wherein the head-mounted display device is configured to track the peripheral hand motion sensing device via the camera.

15 . The system of claim 9 , wherein the head-mounted display device is configured to detect one or more of a letter, a word, and a symbol indicated by the gesture performed by the hand holding the peripheral hand motion sensing device.

16 . The system of claim 9 , wherein the peripheral hand motion sensing device is a first peripheral hand motion sensing device to control a first cursor, and wherein the system further comprises a second peripheral hand motion sensing device to control a second cursor.

17 . A head-mounted display device comprising:

an optical assembly through which at least a part of a surrounding environment and also displayed content are viewable;

an image source configured to introduce content for display via the optical assembly;

a camera configured to image the surrounding environment and detect a hand gesture in a field of view of the camera;

a processor; and

a storage device comprising instructions executable by the processor to control a cursor displayed by the head-mounted display device based on the hand gesture detected by the camera.

18 . The head-mounted display device of claim 17 , wherein the instructions are further executable to detect one or more of a letter, a word, and a symbol indicated by the hand gesture.

19 . The head-mounted display device of claim 17 , wherein the instructions are further executable to display a virtual interactive control element at a fixed location with respect to an object in the surrounding environment based on the hand gesture.

20 . The head-mounted display device of claim 19 , wherein the virtual interactive control element comprises a virtual keyboard, and wherein the instructions are further executable to detect typing on the virtual keyboard based on an additional hand gesture.