Controller for interfacing with a computing program using position, orientation, or motion
View Patent ↗A method for determining the position of a controller device, comprises: receiving dimensions of the display input by a user of the computer-based system; capturing successive images of the display at the controller device; determining a position of the controller device relative to the display based on the dimensions of the display and a perspective distortion of the display in the captured successive images of the display; providing the determined position of the controller to the computer-based system to interface with the interactive program to cause an action by the interactive program.
1. A device for enabling user control for interfacing with a video game, comprising:
at least one inertial sensor;
a camera configured to capture images of an interactive environment;
an image processor configured to process the captured images for identification of trackable features;
a transceiver configured to communicate with a game console that executes the video game, the transceiver configured to transmit data generated by the image processor to the game console, such that a position of the device is determined based on a perspective distortion of the trackable features in the captured images, the determined position of the device being utilized to update a state of the executing video game at the game console;
a harness for attaching the device to the user;
a projector for projecting a radiation pattern;
a second camera for capturing images of the projected radiation pattern, wherein the position of the device is determined based on the captured images of the radiation pattern.
2. The device of claim 1 ,
wherein the projector is an IR projector, and wherein the radiation pattern is an IR radiation pattern; and
wherein the second camera is an IR camera.
3. The device of claim 1 , wherein an orientation of the device is determined based on a location and orientation of the trackable features in the captured images of the interactive environment.
4. The device of claim 1 , wherein the trackable features include one or more of a reflective object, a display, a portion of a display, or a rendering on a display.
5. The device of claim 1 , wherein the at least one inertial sensor includes one or more of an accelerometer, gyroscope or magnetometer; and
wherein the position of the device is determined based on data from the at least one inertial sensor.
6. The device of claim 1 , further comprising one or more of
a display screen, a speaker, a microphone, a light emitter, or a button.
7. The device of claim 1 , wherein the position of the device is determined based on dimensions defined by the trackable features.
8. A method for enabling user control for interfacing with a video game, comprising:
capturing images of an interactive environment by a camera of a device that enables the user control for interfacing with the video game, the device including a harness for attaching the device to the user;
processing the captured images for identification of trackable features;
communicating with a game console that executes the video game to transmit data generated by the image processor to the game console, wherein a position of the device is determined based on the trackable features in the captured images, the determined position of the device being utilized to update a state of the executing video game at the game console;
projecting a radiation pattern from a projector of the device;
capturing images of the projected radiation pattern by a second camera of the device, wherein the position of the device is determined based on the captured images of the radiation pattern.
9. The method of claim 8 ,
wherein the projector is an IR projector, and wherein the radiation pattern is an IR radiation pattern; and
wherein the second camera is an IR camera.
10. The method of claim 8 ,
wherein when the controller device is oriented so as not to enable identification of the trackable features in the captured images of the interactive environment, then the controller device is configured to activate the projector to project the radiation pattern, and activate the second camera to capture the images of the projected radiation pattern.
11. The method of claim 8 , wherein an orientation of the device is determined based on a location and orientation of the trackable features in the captured images of the interactive environment.
12. The method of claim 8 , wherein the trackable features include one or more of a reflective object, a display, a portion of a display, or a rendering on a display.
13. The method of claim 8 , further comprising:
processing data from at least one inertial sensor of the device;
wherein the position of the device is determined based on the data processed from the at least one inertial sensor.
14. The method of claim 8 , further comprising:
determining dimensions defined by the trackable features;
wherein the position of the device is determined based on the dimensions defined by the trackable features.
15. The method of claim 8 , wherein the position of the device is determined based on a perspective distortion of the trackable features in the captured images.