Virtual reality detection and projection system for use with a head mounted display
A Virtual reality system which comprises a head mounted display and positional tracking to determine the position and orientation of the head mounted display. A player wearing the head mounted display would view a virtual world. External physical objects such as a cup can be identified and displayed inside the virtual world displayed inside the head mounted display so that a player can drink out of the cup without having to remove the head mounted display.
1. An apparatus, comprising:
a virtual reality headset configured to be worn on a player's head, the virtual reality headset comprising an output device and a camera array comprising more than two cameras;
a computer configured to communicate with the virtual reality headset, the computer configured to read computer readable instructions from a non-transitory computer readable storage medium, the computer readable instructions are programmed to:
display on the output device a virtual world using a position and an orientation of the headset;
capture respective images of a physical object from individual cameras in the camera array, and compute a respective tracking score for the physical object for each of the individual cameras, the tracking score computed based upon how much of a pattern on physical object is visible, and determine a selection of the respective images of the physical object to utilize based upon the respective tracking scores; and
determine a position and orientation of the physical object using the selection of the respective images.
2. The apparatus as recited in claim 1 , wherein the physical object is a cup.
3. The apparatus as recited in claim 1 , wherein the computer readable instructions are further programmed such that the selection of respective images is a single image.
4. The apparatus as recited in claim 1 , wherein the computer readable instructions are further programmed such that the selection of respective images is a first image and second image, and the using the selection of respective images utilizes a combination of a portion of a first image and a portion of the second image.
5. A method, comprising:
displaying a virtual world on an output device on a virtual reality headset configured to be worn on a player's head, the virtual reality headset comprising an output device, an electronic processor, and a camera array comprising more than two cameras;
executing computer readable instructions stored on a non-transitory computer readable storage medium on the electronic processor, the computer readable instructions causing the electronic processor to perform:
displaying on the output device a virtual world using a position and an orientation of the headset;
capturing respective images of a physical object from individual cameras in the camera array, and computing a respective tracking score for the physical object for each of the individual cameras, the tracking score computed based upon how much of a pattern on the physical object is visible, and determining a selection of the respective images of the physical object to utilize based upon the respective tracking scores; and determining a position and orientation of the physical object using the selection of the respective images.
6. The method as recited in claim 5 , wherein the physical object is a cup.
7. The method as recited in claim 5 , wherein the computer readable instructions are further causing the selection of respective images is a single image.
8. The method as recited in claim 5 , wherein the computer readable instructions are further causing the selection of respective images to comprise a first image and a second image, and the using the selection of respective images utilizes a combination of a portion of a first image and a portion of the second image.