Head mounted display and tracking mode switching method
A head mounted display and a tracking mode switching method are provided. The head mounted display calculates a first motion information corresponding to a controller and a second motion information corresponding to a tracked hand based on the real-time images. The head mounted display determines to switch to a hand-held controller tracking pose mode or a hand tracking pose mode based on a motion relationship between the controller and the tracked hand.
1 . A head mounted display, comprising:
a plurality of depth camera lenses, being configured to generate a plurality of real-time images; and
a processor, being electrically connected to the plurality of depth camera lenses, and being configured to perform the following operations:
calculating a first motion information corresponding to a controller and a second motion information corresponding to a tracked hand based on the plurality of real-time images; and
determining to switch to a hand-held controller tracking pose mode or a hand tracking pose mode based on a motion relationship between the controller and the tracked hand, wherein the motion relationship is generated based on the first motion information and the second motion information, wherein the operation of determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode further comprises the following operations:
determining whether a first movement velocity of the controller and a second movement velocity of the tracked hand are both greater than a velocity threshold; and
in response to the first movement velocity and the second movement velocity being both greater than the velocity threshold, determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode.
2 . The head mounted display of claim 1 , wherein the head mounted display further comprises:
a display device, being electrically connected to the processor;
wherein the processor further performs the following operations:
in response to switching to the hand tracking pose mode, generating a hand tracking pose corresponding to the tracked hand based on the hand tracking pose mode; and
transmitting the hand tracking pose to the display device to make the display device display the hand tracking pose corresponding to the tracked hand.
3 . The head mounted display of claim 1 , wherein the head mounted display further comprises:
a display device, being electrically connected to the processor;
wherein the processor further performs the following operations:
in response to switching to the hand-held controller tracking pose mode, generating a controller tracking pose corresponding to the controller based on the hand-held controller tracking pose mode, and hiding a hand tracking pose corresponding to the tracked hand; and
transmitting the controller tracking pose to the display device to make the display device display the controller tracking pose corresponding to the controller.
4 . The head mounted display of claim 3 , wherein the processor is further configured to perform the following operations:
generating a new hand tracking pose corresponding to the tracked hand based on the controller tracking pose; and
transmitting the new hand tracking pose to the display device to make the display device display the new hand tracking pose corresponding to the tracked hand.
5 . The head mounted display of claim 4 , wherein the operation of generating the new hand tracking pose corresponding to the tracked hand comprises the following operations:
synthesizing a virtual hand image to the controller tracking pose to generate the new hand tracking pose.
6 . The head mounted display of claim 1 , wherein the operation of determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode further comprises the following operations:
determining whether a spatial distance between the controller and the tracked hand is greater than or equal to a distance threshold; and
in response to the spatial distance being greater than or equal to the distance threshold, determining to switch to the hand tracking pose mode.
7 . The head mounted display of claim 6 , wherein the operation of calculating the spatial distance between the controller and the tracked hand comprises the following operations:
calculating a first spatial position of the controller and a second spatial position corresponding to the tracked hand based on the plurality of real-time images; and
calculating the spatial distance between the controller and the tracked hand based on the first spatial position and the second spatial position.
8 . The head mounted display of claim 1 , wherein the operation of determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode further comprises the following operations:
determining whether a spatial distance between the controller and the tracked hand is lower than a distance threshold;
in response to the spatial distance being lower than the distance threshold, determining whether an angle difference between a first motion vector corresponding to the controller and a second motion vector corresponding to the tracked hand is lower than an angle threshold; and
in response to the angle difference being lower than the angle threshold, determining to switch to the hand-held controller tracking pose mode.
9 . The head mounted display of claim 8 , wherein before performing the operation of determining whether the angle difference is lower than the angle threshold, the processor further performs the following operations:
determining whether the first movement velocity of the controller and the second movement velocity of the tracked hand are both greater than the velocity threshold;
in response to the first movement velocity and the second movement velocity being both greater than the velocity threshold, determining whether the angle difference is lower than the angle threshold; and
in response to the first movement velocity and the second movement velocity not both being greater than the velocity threshold, suspending to execute the operation of determining the angle difference.
10 . The head mounted display of claim 1 , wherein the processor further performs the following operations:
receiving a sequence of a plurality of inertial measurement parameters from the controller; and
calculating the first motion information corresponding to the controller based on the plurality of real-time images and the plurality of inertial measurement parameters.
11 . A tracking mode switching method, being adapted for use in an electronic apparatus, wherein the electronic apparatus comprises a plurality of depth camera lenses and a processor, the plurality of depth camera lenses is configured to generate a plurality of real-time images, and the tracking mode switching method comprises the following step:
calculating a first motion information corresponding to a controller and a second motion information corresponding to a tracked hand based on the plurality of real-time images; and
determining to switch to a hand-held controller tracking pose mode or a hand tracking pose mode based on a motion relationship between the controller and the tracked hand, wherein the motion relationship is generated based on the first motion information and the second motion information, wherein the step of determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode further comprises the following steps:
determining whether a first movement velocity of the controller and a second movement velocity of the tracked hand are both greater than a velocity threshold; and
in response to the first movement velocity and the second movement velocity being both greater than the velocity threshold, determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode.
12 . The tracking mode switching method of claim 11 , wherein the electronic apparatus further comprises a display device, and the tracking mode switching method further comprises the following steps:
in response to switching to the hand tracking pose mode, generating a hand tracking pose corresponding to the tracked hand based on the hand tracking pose mode; and
transmitting the hand tracking pose to the display device to make the display device display the hand tracking pose corresponding to the tracked hand.
13 . The tracking mode switching method of claim 11 , wherein the electronic apparatus further comprises a display device, and the tracking mode switching method further comprises the following steps:
in response to switching to the hand-held controller tracking pose mode, generating a controller tracking pose corresponding to the controller based on the hand-held controller tracking pose mode, and hiding a hand tracking pose corresponding to the tracked hand; and
transmitting the controller tracking pose to the display device to make the display device display the controller tracking pose corresponding to the controller.
14 . The tracking mode switching method of claim 13 , wherein the tracking mode switching method further comprises the following steps:
generating a new hand tracking pose corresponding to the tracked hand based on the controller tracking pose; and
transmitting the new hand tracking pose to the display device to make the display device display the new hand tracking pose corresponding to the tracked hand.
15 . The tracking mode switching method of claim 14 , wherein the step of generating the new hand tracking pose corresponding to the tracked hand comprises the following steps:
synthesizing a virtual hand image to the controller tracking pose to generate the new hand tracking pose.
16 . The tracking mode switching method of claim 11 , wherein the step of determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode further comprises the following steps:
determining whether a spatial distance between the controller and the tracked hand is greater than or equal to a distance threshold; and
in response to the spatial distance being greater than or equal to the distance threshold, determining to switch to the hand tracking pose mode.
17 . The tracking mode switching method of claim 16 , wherein the step of calculating the spatial distance between the controller and the tracked hand comprises the following steps:
calculating a first spatial position of the controller and a second spatial position corresponding to the tracked hand based on the plurality of real-time images; and
calculating the spatial distance between the controller and the tracked hand based on the first spatial position and the second spatial position.
18 . The tracking mode switching method of claim 11 , wherein the step of determining to switch to the hand-held controller tracking pose mode or the hand tracking pose mode further comprises the following steps:
determining whether a spatial distance between the controller and the tracked hand is lower than a distance threshold;
in response to the spatial distance being lower than the distance threshold, determining whether an angle difference between a first motion vector corresponding to the controller and a second motion vector corresponding to the tracked hand is lower than an angle threshold; and
in response to the angle difference being lower than the angle threshold, determining to switch to the hand-held controller tracking pose mode.
19 . The tracking mode switching method of claim 18 , wherein before performing the step of determining whether the angle difference is lower than the angle threshold, the tracking mode switching method further comprises the following steps:
determining whether the first movement velocity of the controller and the second movement velocity of the tracked hand are both greater than the velocity threshold;
in response to the first movement velocity and the second movement velocity being both greater than the velocity threshold, determining whether the angle difference is lower than the angle threshold; and
in response to the first movement velocity and the second movement velocity not both being greater than the velocity threshold, suspending to execute the operation of determining the angle difference.
20 . The tracking mode switching method of claim 11 , wherein the tracking mode switching method further comprises the following steps:
receiving, by the electronic apparatus, a sequence of a plurality of inertial measurement parameters from the controller; and
calculating, by the electronic apparatus, the first motion information corresponding to the controller based on the plurality of real-time images and the plurality of inertial measurement parameters.