Computer control with heads-up display
View Patent ↗A method, computer-readable medium and apparatus are described for providing a user interface control for use with a manipulable object, such as a weapon. As the object is moved, images from a video camera are projected into a heads-up display. A user of the object may activate a user interface control by pressing a button on the object, causing an image of a user interface control to be projected into the heads-up display. Movement of the object may cause a cursor to be moved across the heads-up display, allowing the user to select user interface features without removing hands from the object. Pressing a button may cause a mouse click command to be generated, allowing the user to type or perform other functions.
1. A weapon system comprising:
a weapon having mounted thereon at least one switch, a video camera, and a measurement device configured to output signals indicative of movement of the weapon;
a heads-up display providing a field of view and configured to project a first image into a first eye of a wearer; and
a computer programmed with executable instructions that, when executed by the computer, perform:
outputting the first image to the heads-up display;
detecting activation of the at least one switch and, in response thereto, replacing the first image with an image of a computer control function including a cursor;
detecting movement of the weapon from the measurement device; and
causing the cursor to move on the image of the computer control function in response to movement of the weapon.
2. The weapon system of claim 1 , wherein the executable instructions further perform:
detecting activation of a second switch mounted on the weapon and, in response thereto, generating a mouse click command.
3. The weapon system of claim 2 , wherein the executable instructions further perform:
detecting a second activation of the first switch and, in response thereto, removing the image of the computer control function from the heads-up display.