Constellation-based augmentation of mouse form-factor for virtual reality applications
Techniques that modify traditional input devices (e.g., traditional computer mouse form factor) to interact with the virtual reality (VR) devices are described. Such modification allows the VR devices the ability to track the position and orientation of the mouse in the 3 dimensional (3D) VR without requiring extensive complex hardware typically included in VR motion controllers. Specifically, the traditional mouse form factor may be merged with 3D constellation based tracking elements (e.g., LEDs) with minimal form-factor modifications. The constellation tracking elements may include a plurality of fiducial markers on the mouse that may be detected by an imaging sensor, and thus allow tracking with a single imaging sensor (e.g., either head-mounted or fixed position).
1. A method for tracking a computer mouse in a virtual reality environment, comprising:
detecting, by an image sensor of a head mounted display (HMD), one or more light sources from the computer mouse;
correlating the one or more light sources with a profile of the computer mouse by matching the detected one or more light sources with known positions of the one or more light sources;
determining a position and orientation of the computer mouse based on the correlation of the one or more light sources; and
rendering an image of the computer mouse on a display of the HMD within the virtual reality environment based on the position and orientation determination,
wherein correlating the one or more light sources with the profile of the computer mouse comprises:
determining whether an orientation of the one or more light sources corresponds to at least one of a plurality of profiles stored in a database for the computer mouse; and
identifying the profile from the plurality of profiles based on the orientation of the computer mouse.
2. The method of claim 1 , wherein the one or more light sources are a plurality of fiducial markers on surface of the computer mouse that emit light.
3. The method of claim 2 , wherein the fiducial markers are positioned such that at least a subset of a complete set of fiducial markers remain exposed when a user covers the computer mouse with a hand.
4. The method of claim 1 , further comprising:
tracking a movement of the computer mouse on the display of the HMD with the virtual reality environment by tracking the one or more light sources.
5. The method of claim 1 , wherein determining the position and orientation of the computer mouse comprises:
locating the computer mouse in physical environment; and
associating a projected image of the computer mouse in physical environment with a location in the virtual environment.
6. The method of claim 1 , wherein the computer mouse excludes inertial measurement units (IMUs).
7. A computer device for tracking computer mouse in a virtual reality environment, comprising:
a memory to store data and instructions; and
a processor in communication with the memory to execute the instructions to:
detect, by an image sensor of a head mounted display (HMD), one or more light sources from the computer mouse;
correlate the one or more light sources with a profile of the computer mouse by matching the detected one or more light sources with known positions of the one or more light sources;
determine a position and orientation of the computer mouse based on the correlation of the one or more light sources; and
render an image of the computer mouse on a display of the HMD within the virtual reality environment based on the position and orientation determination,
wherein the instructions to correlate the one or more light sources with the profile of the computer mouse further include instructions to:
determine whether an orientation of the one or more light sources corresponds to at least one of a plurality of profiles stored in a database for the computer mouse; and
identify the profile from the plurality of profiles based on the orientation of the computer mouse.
8. The computer device of claim 7 , wherein the computer includes one or more light sources are a plurality of fiducial markers on surface of the computer mouse that emit light.
9. The computer device of claim 8 , wherein the fiducial markers are positioned such that at least a subset of a complete set of fiducial markers remain exposed when a user covers the computer mouse with a hand.
10. The computer device of claim 7 , wherein the instructions are further executable to:
track a movement the computer mouse on the display of the HMD with the virtual reality environment by tracking the one or more light sources as the profile of the computer mouse.
11. The computer device of claim 7 , wherein the instructions are further executable to:
locate the computer mouse in physical environment; and
associate a projected image of the computer mouse in physical environment with a location in the virtual environment.
12. The computer device of claim 7 , wherein the computer mouse excludes inertial measurement units (IMUs).
13. A non-transitory computer-readable medium storage device storing instructions executable by a computer device for tracking an computer mouse in a virtual reality environment, the instructions comprising code for:
detecting, by an image sensor of a head mounted display (HMD), one or more light sources from the computer mouse;
correlating the one or more light sources with a profile of the computer mouse by matching the detected one or more light sources with known positions of the one or more light sources;
determining a position and orientation of the computer mouse based on the correlation of the one or more light sources; and
rendering an image of the computer mouse on a display of the HMD within the virtual reality environment based on the position and orientation determination,
wherein the code for correlating the one or more light sources with the profile of the computer mouse further comprises code for:
determine whether an orientation of the one or more light sources corresponds to at least one of a plurality of profiles stored in a database for the computer mouse; and
identify the profile from the plurality of profiles based on the orientation of the computer mouse.
14. The non-transitory computer-readable medium storage device of claim 13 , wherein the one or more light sources are a plurality of fiducial markers on surface of the computer mouse that emit light.
15. The non-transitory computer-readable medium storage device of claim 14 , wherein the fiducial markers are positioned such that at least a subset of a complete set of fiducial markers remain exposed when a user covers the computer mouse with a hand.
16. The non-transitory computer-readable medium storage device of claim 13 , further comprising code for:
tracking a movement of the computer mouse on the display of the HMD with the virtual reality environment by tracking the one or more light sources as the profile of the computer mouse.
17. The non-transitory computer-readable medium device of claim 13 , wherein the computer mouse excludes inertial measurement units (IMUs).