Interactive exercise and training system and method
A virtual reality (VR) system comprising a head-mounted display (HMD) and handheld controller set is enhanced to provide a more realistic end user VR experience, e.g., for boxing or other interactive training. In this approach, and in lieu of simply establishing a boundary area for the VR experience, the user also maps a position of a real-world object into a reference frame of the VR environment. This mapping is facilitated using the handheld controller itself, e.g., as positioned in a backwards-facing manner on the user's forearm. The real-world object is then simulated in the 3D VR environment as rendered by the VR HMD, and the user interacts with the real-world object (or its simulation) to provide a more enjoyable and useful interactive experience.
1. A computer program product in a non-transitory computer-readable medium and comprising program code configured to be executed in one or more hardware processors associated with a virtual reality (VR) console, the VR console in association with a VR headset configured to spatially project a real-world object into a three-dimensional (3D) virtual space, the program code comprising code configured to:
identify an endpoint position of a user's appendage with respect to a reference frame in a virtual reality (VR) environment;
receive one or more control signals mapping given points of a facing surface of the real-world object to points in the reference frame of the VR environment;
project the facing surface into the 3D virtual space together with a real-time video feed;
thereafter, tracking a user's simulated interaction with the real-world object;
wherein the real-world object is associated with a training session.