Devices, systems, and methods for virtual representation of user interface devices
The disclosed computer-implemented method may include communicatively coupling a user interface device to a virtual reality device, capturing inputs from a user on the user interface device, displaying, on the virtual reality device, a virtual representation of the captured inputs from the user, and mirroring, on the virtual reality device, content presented on the user interface device. Various other methods, systems, and computer-readable media are also disclosed.
1. A method comprising:
communicatively coupling a user interface device to a virtual reality device;
capturing inputs from a user on the user interface device;
displaying, on the virtual reality device, a virtual representation of the user interface device based on stored parameters associated with the user interface device;
displaying, on the virtual reality device, position indicators as an overlay on top of the virtual representation of the user interface device, wherein the position indicators indicate a position of an object as the object moves relative to the position of the user interface device;
determining a position of the user interface device relative to the virtual reality device based on at least one distinguishable feature of the user interface device;
displaying, on the virtual reality device, a virtual representation of the captured inputs from the user; and
mirroring, on the virtual reality device, content presented on the user interface device.
2. The method of claim 1 , wherein the virtual representation of the captured inputs from the user comprises tracking movements of at least one of:
at least one hand of the user; or
the user interface device.
3. The method of claim 2 , wherein tracking movements comprises determining at least one of a location or an orientation of:
the at least one hand of the user; or
the user interface device.
4. The method of claim 3 , wherein determining the at least one of the location or the orientation of the at least one hand of the user or the user interface device is based on at least one of:
inertial measurement data transmitted from the user interface device to the virtual reality device;
radar ranging data from a radar device on the virtual reality device; or
image tracking data from an image sensor on the virtual reality device.
5. The method of claim 1 , wherein capturing the inputs from the user on the user interface device comprises capturing images via an image sensor on the virtual reality device.
6. The method of claim 1 , wherein the inputs from the user comprises at least one of a text input, a voice input, or a selection input.
7. The method of claim 1 , wherein displaying, on the virtual reality device, a virtual representation of the captured inputs from the user comprises:
capturing an image of the user interface device in a real-world environment;
subtracting the image of the user interface device from a background of the real-world environment; and
superimposing the subtracted image of the user interface device into a virtual environment of the virtual reality device.
8. The method of claim 1 , wherein mirroring, on the virtual reality device, content presented on the user interface device comprises a wireless transmission of the content from the user interface device to the virtual reality device.
9. The method of claim 1 , further comprising displaying, on the virtual reality device, animated content around the user interface device.
10. The method of claim 1 , further comprising mirroring, on a virtual reality device associated with another user, the content presented on the user interface device.
11. The method of claim 1 , wherein the captured inputs from the user on the user interface device function as controls for the virtual reality device.
12. The method of claim 1 , wherein the user interface device is at least one of a smartphone, a keyboard, a display, a tablet device, or a remote controller.
13. A system comprising:
a user interface device configured to communicate with a virtual reality device, wherein:
the user interface device is configured to capture inputs from a user; and
the virtual reality device is configured to:
display, on the virtual reality device, a virtual representation of the user interface device based on stored parameters associated with the user interface device;
display, on the virtual reality device, position indicators as an overlay on top of the virtual representation of the user interface device, wherein the position indicators indicate a position of an object as the object moves relative to the position of the user interface device;
determine a position of the user interface device relative to the virtual reality device based on at least one distinguishable feature of the user interface device;
display a virtual representation of the captured inputs from the user; and
mirror content presented on the user interface device.
14. The system of claim 13 , wherein the virtual representation of the captured inputs from the user comprises tracking movements of at least one of:
at least one hand of the user; or
the user interface device.
15. The system of claim 14 , wherein tracking movements comprises determining at least one of a location or an orientation of:
the at least one hand of the user; or
the user interface device.
16. The system of claim 15 , wherein determining the at least one of the location or the orientation of the at least one hand of the user or
the user interface device is based on at least one of:
inertial measurement data transmitted from the user interface device to the virtual reality device;
radar ranging data from a radar device on the virtual reality device; or
image tracking data from an image sensor on the virtual reality device.
17. The system of claim 13 , wherein capturing the inputs from the user on the user interface device comprises capturing images via an image sensor on the virtual reality device.
18. A non-transitory computer-readable medium comprising:
computer-readable instructions that, when executed by at least one processor of a computing device, cause the computing device to:
communicatively couple a user interface device to a virtual reality device;
capture inputs from a user on the user interface device;
display, on the virtual reality device, a virtual representation of the user interface device based on stored parameters associated with the user interface device;
display, on the virtual reality device, position indicators as an overlay on top of the virtual representation of the user interface device, wherein the position indicators indicate a position of an object as the object moves relative to the position of the user interface device;
determine a position of the user interface device relative to the virtual reality device based on at least one distinguishable feature of the user interface device;
display, on the virtual reality device, a virtual representation of the captured inputs from the user; and
mirror content presented on the user interface device on the virtual reality device.
19. The method of claim 7 , wherein a position of the subtracted image of the user interface device in the virtual environment corresponds to a location of the user interface device within the real-world environment.